Sep 09 13:06:25 devstack cinder-volume[76624]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 13:06:25 devstack cinder-volume[76624]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 13:06:25 devstack cinder-volume[76624]: we strongly recommend against using it for new projects.
Sep 09 13:06:25 devstack cinder-volume[76624]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 13:06:25 devstack cinder-volume[76624]: framework.  For more detail see
Sep 09 13:06:25 devstack cinder-volume[76624]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 13:06:25 devstack cinder-volume[76624]:   import eventlet  # noqa
Sep 09 13:06:28 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:06:28 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:06:28 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:06:29 devstack cinder-volume[76624]: INFO dbcounter [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Registered counter for database cinder
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG oslo_db.sqlalchemy.engines [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writer thread running {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:06:29 devstack cinder-volume[76624]: INFO cinder.rpc [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 13:06:29 devstack cinder-volume[76624]: INFO cinder.rpc [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG oslo_db.sqlalchemy.engines [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:06:29 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Determined volume DB was empty at startup.
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76624) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 13:06:29 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 09 13:06:29 devstack cinder-volume[76624]: WARNING stevedore.named [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 13:06:29 devstack cinder-volume[76624]: WARNING castellan.key_manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:06:29 devstack cinder-volume[76624]: WARNING cinder.keymgr.conf_key_mgr [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76624) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 09 13:06:29 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] CMD "cinder-rtstool verify" returned: 0 in 0.388s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_db.sqlalchemy.engines [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:06:30 devstack cinder-volume[76624]: INFO cinder.rpc [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 09 13:06:30 devstack cinder-volume[76624]: INFO cinder.rpc [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 09 13:06:30 devstack cinder-volume[76624]: WARNING stevedore.named [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 13:06:30 devstack cinder-volume[76624]: WARNING castellan.key_manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:06:30 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_db.sqlalchemy.engines [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:06:30 devstack cinder-volume[76624]: INFO oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Starting 1 workers
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Started child 76785 {{(pid=76624) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Full set of CONF: {{(pid=76624) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] ******************************************************************************** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Configuration options gathered from: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] ================================================================================ {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] allow_availability_zone_fallback = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] allow_compression_on_image_upload = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] allowed_direct_url_schemes     = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76785]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] api_rate_limit                 = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] auth_strategy                  = keystone {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] az_cache_duration              = 3600 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_availability_zone      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_host                   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_name                   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_stats_polling_interval = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backup_api_class               = cinder.backup.api.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backup_name_template           = backup-%s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backup_use_same_host           = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backup_use_temp_snapshot       = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] chap_password                  = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] chap_username                  =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_internal_tenant_project_id = 261e13d4c2d34f218e49bb6ced3a2169 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_internal_tenant_user_id = 0f82fc0b29e3442e8c73d6f4dc21820b {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cloned_volume_same_az          = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cluster                        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] compression_format             = gzip {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] config_dir                     = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] config_source                  = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] control_exchange               = openstack {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] debug                          = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] default_availability_zone      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] default_group_type             = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] default_volume_type            = lvmdriver-1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] disk_geometry                  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_client_cert             = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_client_cert_key         = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_data_namespace          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_ssl_cert_path           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_ssl_cert_verify         = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] driver_use_ssl                 = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] enable_force_upload            = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] enable_new_services            = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] enable_unsupported_driver      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] enforce_multipath_for_image_xfer = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] filter_function                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_api_insecure            = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_api_servers             = ['http://192.168.122.110/image'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_api_ssl_compression     = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_ca_certificates_file    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_certfile                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_keyfile                 = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_num_retries             = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance_request_timeout         = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] goodness_function              = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] graceful_shutdown_timeout      = 5 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] group_api_class                = cinder.group.api.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] host                           = devstack {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_compress_on_upload       = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_conversion_address_space_limit = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_conversion_cpu_limit     = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_conversion_disable       = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_upload_use_cinder_backend = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_upload_use_internal_tenant = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_volume_cache_enabled     = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_volume_cache_max_count   = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] image_volume_cache_max_size_gb = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] init_host_max_objects_retrieval = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iscsi_target_flags             =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iscsi_write_cache              = on {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iser_helper                    = tgtadm {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iser_ip_address                = 192.168.122.110 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iser_port                      = 3260 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_color                      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_config_append              = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_dir                        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_file                       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_options                    = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_rotate_interval            = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_rotate_interval_type       = days {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] log_rotation_type              = none {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] max_age                        = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] max_logfile_count              = 30 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] max_logfile_size_mb            = 200 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] max_over_subscription_ratio    = 20.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] message_reap_interval          = 86400 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] message_ttl                    = 2592000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] migration_create_volume_timeout_secs = 300 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] monkey_patch                   = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76785]: INFO cinder.volume.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] monkey_patch_modules           = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] my_ip                          = 192.168.122.110 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] no_snapshot_gb_quota           = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] num_iser_scan_tries            = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] num_shell_tries                = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] num_volume_device_scan_tries   = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] nvmeof_conn_info_version       = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] nvmet_ns_id                    = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] nvmet_port_id                  = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_max_limit                = 1000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_ext_list          = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_listen_port       = 8776 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_use_ssl           = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] osapi_volume_workers           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] per_volume_size_limit          = -1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] periodic_fuzzy_delay           = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] periodic_interval              = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] public_endpoint                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] publish_errors                 = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_backup_gigabytes         = 1000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_backups                  = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_gigabytes                = 1000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_groups                   = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_snapshots                = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] quota_volumes                  = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] rate_limit_burst               = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] rate_limit_except_level        = CRITICAL {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] rate_limit_interval            = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] reinit_driver_count            = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] replication_device             = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] report_discard_supported       = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] report_interval                = 120 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] reservation_clean_interval     = 86400 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] reservation_expire             = 86400 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] reserved_image_namespaces      = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] reserved_percentage            = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] rpc_response_timeout           = 120 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] run_external_periodic_tasks    = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] scst_target_driver             = iscsi {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] scst_target_iqn_name           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_down_time              = 720 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] shell_completion               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] snapshot_name_template         = snapshot-%s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] snapshot_same_host             = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] split_loggers                  = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] state_path                     = /opt/stack/data/cinder {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] storage_availability_zone      = nova {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] storage_protocol               = iSCSI {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] syslog_log_facility            = LOG_USER {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_helper                  = lioadm {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_ip_address              = 192.168.122.110 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_port                    = 3260 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_protocol                = iscsi {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] target_secondary_ip_addresses  = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] trace_flags                    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] transport_url                  = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] until_refresh                  = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_chap_auth                  = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_default_quota_class        = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_journal                    = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_json                       = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_multipath_for_image_xfer   = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_stderr                     = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] use_syslog                     = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] verify_glance_signatures       = enabled {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_api_class               = cinder.volume.api.API {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_backend_name            = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_clear                   = zero {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_clear_ionice            = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_clear_size              = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_copy_bps_limit          = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_dd_blocksize            = 1M {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_name_template           = volume-%s {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_service_inithost_offload = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volume_usage_audit_period      = month {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] zoning_mode                    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_concurrency.disable_process_locking = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.auth_section = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.auth_type   = password {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.auth_version = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.cache       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.certfile    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.include_service_catalog = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.insecure    = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.interface   = public {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.keyfile     = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_password = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcache_username = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.region_name = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.service_type = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.backend                  = dogpile.cache.null {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.backend_argument         = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.backend_expiration_time  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.config_prefix            = cache.oslo {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.debug_cache_backend      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.enable_retry_client      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.enable_socket_keepalive  = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.enabled                  = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.expiration_time          = 600 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.hashclient_retry_attempts = 2 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_dead_retry      = 300 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_sasl_enabled    = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.password                 = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.proxies                  = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.redis_db                 = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.redis_server             = localhost:6379 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.retry_attempts           = 2 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.retry_delay              = 0.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.socket_keepalive_count   = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.socket_keepalive_idle    = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.socket_keepalive_interval = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.socket_timeout           = 1.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.tls_allowed_ciphers      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.tls_cafile               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.tls_certfile             = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.tls_enabled              = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.tls_keyfile              = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cache.username                 = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] coordination.backend_url       = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.asyncio_connection    = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.asyncio_slave_connection = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.backend               = sqlalchemy {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.connection            = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.connection_debug      = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.connection_parameters =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.connection_recycle_time = 3600 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.connection_trace      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.db_inc_retry_interval = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.db_max_retries        = 20 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.db_max_retry_interval = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.db_retry_interval     = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.max_overflow          = 50 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.max_pool_size         = 5 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.max_retries           = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.mysql_wsrep_sync_wait = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.pool_timeout          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.retry_interval        = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.slave_connection      = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.sqlite_synchronous    = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.synchronous_reader    = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] database.use_db_reconnect      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_tracing.insecure = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.connection_string     = messaging:// {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.enabled               = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.es_doc_type           = notification {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.es_scroll_size        = 10000 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.es_scroll_time        = 2m {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.filter_error_trace    = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.hmac_keys             = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.sentinel_service_name = mymaster {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.socket_timeout        = 0.1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.trace_requests        = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler.trace_sqlalchemy      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler_jaeger.process_tags   = {} {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler_jaeger.service_name_prefix = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] profiler_otlp.service_name_prefix = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.enforce_new_defaults = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.policy_default_rule = default {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.group          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.helper_command = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] privsep_osbrick.user           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.group         = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.helper_command = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] cinder_sys_admin.user          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.auth_section      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.auth_type         = password {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.cafile            = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.certfile          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.collect_timing    = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.insecure          = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.keyfile           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.send_service_user_token = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.split_loggers     = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.timeout           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.tls_ciphers       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] service_user.tls_min_version   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.auth_section            = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.auth_type               = password {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.certfile                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.collect_timing          = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.insecure                = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.keyfile                 = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.region_name             = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.split_loggers           = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.timeout                 = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.tls_ciphers             = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] glance.tls_min_version         = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.backend_availability_zone = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.chap_password = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.chap_username =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.disk_geometry = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_client_cert = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_client_cert_key = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_data_namespace = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.driver_use_ssl = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.extra_capabilities = {} {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.filter_function = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.goodness_function = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iscsi_target_flags =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iscsi_write_cache = on {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iser_port     = 3260 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.lvm_share_target = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.lvm_type      = auto {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.num_shell_tries = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.replication_device = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.report_discard_supported = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.reserved_percentage = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack sudo[76789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_helper = tgtadm {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_port   = 3260 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_protocol = iscsi {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.trace_flags   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.unique_fqdn_network = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.use_chap_auth = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_backend_name = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_clear  = zero {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_clear_ionice = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_clear_size = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_reports.file_event_handler = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_reports.log_dir           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.backend_host       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.chap_password      = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.chap_username      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.disk_geometry      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_client_cert = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.extra_capabilities = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.filter_function    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.goodness_function  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iser_helper        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iser_port          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.lvm_type           = auto {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.replication_device = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.report_discard_supported = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.reserved_percentage = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.scst_target_driver = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.storage_protocol   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_ip_address  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_port        = 3260 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.trace_flags        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_clear       = zero {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] lvmdriver-1.volumes_dir        = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_notifications.driver = [] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_notifications.retry = -1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] key_manager.fixed_key          = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.barbican_api_version  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.barbican_endpoint     = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.barbican_endpoint_type = public {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.barbican_region_name  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.cafile                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.certfile              = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.collect_timing        = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.insecure              = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.keyfile               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.number_of_retries     = 60 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.retry_delay           = 1 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.send_service_user_token = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.split_loggers         = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.timeout               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.tls_ciphers           = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.tls_min_version       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.verify_ssl            = True {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican.verify_ssl_path       = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.auth_section = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.auth_type = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.cafile   = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.certfile = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.collect_timing = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.insecure = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.keyfile  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.split_loggers = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.timeout  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.tls_ciphers = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] barbican_service_user.tls_min_version = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.approle_role_id          = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.approle_secret_id        = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.auth_method              = approle {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.auth_path                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.kv_mountpoint            = secret {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.kv_path                  = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.kv_version               = 2 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.namespace                = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.root_token_id            = **** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.ssl_ca_crt_file          = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.timeout                  = 60.0 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.token_file               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.token_role               = None {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.use_ssl                  = False {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:06:30 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] ******************************************************************************** {{(pid=76624) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 13:06:31 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:31 devstack sudo[76880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:31 devstack sudo[76880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:31 devstack sudo[76880]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.290s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:06:31 devstack cinder-volume[76785]: INFO cinder.brick.local_dev.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:31 devstack sudo[76986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:31 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:31 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG cinder.brick.local_dev.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76785) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 09 13:06:31 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:31 devstack sudo[77067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:31 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:32 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:32 devstack sudo[77253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:32 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:32 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:32 devstack sudo[77345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 09 13:06:32 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:32 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.333s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:32 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:32 devstack sudo[77402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:32 devstack sudo[77402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:33 devstack sudo[77402]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:33 devstack sudo[77486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:33 devstack sudo[77486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:33 devstack sudo[77486]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:33 devstack sudo[77489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:33 devstack sudo[77489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:33 devstack sudo[77489]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:33 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:33 devstack sudo[77533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:33 devstack sudo[77533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:34 devstack sudo[77533]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:34 devstack sudo[77582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:34 devstack sudo[77582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:34 devstack sudo[77582]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:34 devstack cinder-volume[76785]: INFO cinder.volume.drivers.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:34 devstack sudo[77592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:34 devstack sudo[77592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:34 devstack sudo[77592]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:06:34 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:34 devstack sudo[77595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:34 devstack sudo[77595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:35 devstack sudo[77595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:35 devstack sudo[77598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:35 devstack sudo[77598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:35 devstack sudo[77598]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:35 devstack sudo[77601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:35 devstack sudo[77601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:35 devstack sudo[77601]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:35 devstack sudo[77604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:35 devstack sudo[77604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:35 devstack sudo[77604]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:35 devstack cinder-volume[76785]: INFO cinder.volume.driver [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG cinder.volume.driver [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76785) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_db.sqlalchemy.engines [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writer thread running {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG cinder.db.api [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Building query based on filter {{(pid=76785) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG cinder.image.image_utils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76785) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 13:06:35 devstack cinder-volume[76785]: INFO cinder.keymgr.migration [None req-5a4f3c4f-a6ed-4c3c-852f-65ff0faa423f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:06:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:35 devstack sudo[77607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:35 devstack sudo[77607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:36 devstack sudo[77607]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:36 devstack sudo[77612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:36 devstack sudo[77612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:36 devstack sudo[77612]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:36 devstack sudo[77616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:36 devstack sudo[77616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:36 devstack sudo[77616]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:36 devstack sudo[77619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:36 devstack sudo[77619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:37 devstack sudo[77619]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG cinder.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Notifying Schedulers of capabilities ... {{(pid=76785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:06:37 devstack cinder-volume[76785]: INFO cinder.volume.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Driver initialization completed successfully.
Sep 09 13:06:37 devstack cinder-volume[76785]: INFO cinder.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Initiating service 2 cleanup
Sep 09 13:06:37 devstack cinder-volume[76785]: INFO cinder.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Service 2 cleanup completed.
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG cinder.service [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Creating RPC server for service cinder-volume {{(pid=76785) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG cinder.service [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76785) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 13:06:37 devstack cinder-volume[76785]: INFO cinder.volume.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:37 devstack sudo[77622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:06:37 devstack sudo[77622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:37 devstack sudo[77622]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:37 devstack sudo[77627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:37 devstack sudo[77627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:37 devstack sudo[77627]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:37 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:37 devstack sudo[77633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:06:37 devstack sudo[77633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:38 devstack sudo[77633]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:38 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:38 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:06:38 devstack sudo[77637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:06:38 devstack sudo[77637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:06:38 devstack sudo[77637]: pam_unix(sudo:session): session closed for user root
Sep 09 13:06:38 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:06:38 devstack cinder-volume[76785]: INFO cinder.volume.manager [None req-8e0242c7-c9ed-4194-8683-4bc9e5d0e6ad None None] Driver post RPC initialization completed successfully.
Sep 09 13:06:40 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:06:48 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writing DB stats cinder:SELECT=4 {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:06:48 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:07:35 devstack sudo[79610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:07:35 devstack sudo[79610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:07:35 devstack sudo[79610]: pam_unix(sudo:session): session closed for user root
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:07:35 devstack sudo[79645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:07:35 devstack sudo[79645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:07:35 devstack sudo[79645]: pam_unix(sudo:session): session closed for user root
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:07:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:07:35 devstack sudo[79648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:07:35 devstack sudo[79648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:07:36 devstack sudo[79648]: pam_unix(sudo:session): session closed for user root
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:07:36 devstack sudo[79651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:07:36 devstack sudo[79651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:07:36 devstack sudo[79651]: pam_unix(sudo:session): session closed for user root
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG cinder.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Notifying Schedulers of capabilities ... {{(pid=76785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager._thread_info {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread count: 6 {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:07:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread info: [<_MainThread(MainThread, started 123319298547840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123319188714304)>, <Thread(Thread-3 (stat_writer), started daemon 123319184734336)>, <Thread(Rabbit-heartbeat, started daemon 123319184174656)>, <Thread(Thread-5 (_runner), started daemon 123319183528384)>, <Thread(Thread-7 (_runner), started daemon 123319183663360)>] {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:08:35 devstack sudo[82928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:08:35 devstack sudo[82928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:08:35 devstack sudo[82928]: pam_unix(sudo:session): session closed for user root
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:08:35 devstack sudo[82931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:08:35 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:08:35 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:08:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:08:35 devstack sudo[82935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:08:35 devstack sudo[82935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:08:36 devstack sudo[82935]: pam_unix(sudo:session): session closed for user root
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:08:36 devstack sudo[82942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:08:36 devstack sudo[82942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:08:36 devstack sudo[82942]: pam_unix(sudo:session): session closed for user root
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG cinder.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Notifying Schedulers of capabilities ... {{(pid=76785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager._thread_info {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread count: 6 {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:08:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread info: [<_MainThread(MainThread, started 123319298547840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123319188714304)>, <Thread(Thread-3 (stat_writer), started daemon 123319184734336)>, <Thread(Rabbit-heartbeat, started daemon 123319184174656)>, <Thread(Thread-5 (_runner), started daemon 123319183528384)>, <Thread(Thread-7 (_runner), started daemon 123319183663360)>] {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:08:48 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writing DB stats cinder:SELECT=1 {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:08:48 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writing DB stats cinder:UPDATE=1 {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:09:35 devstack sudo[84924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:09:35 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:09:35 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:09:35 devstack sudo[84931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:09:35 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:09:35 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:09:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:09:35 devstack sudo[84950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:09:35 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:09:36 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:09:36 devstack sudo[84955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:09:36 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:09:36 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG cinder.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Notifying Schedulers of capabilities ... {{(pid=76785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager._thread_info {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread count: 6 {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:09:36 devstack cinder-volume[76785]: DEBUG cinder.volume.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] thread info: [<_MainThread(MainThread, started 123319298547840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123319188714304)>, <Thread(Thread-3 (stat_writer), started daemon 123319184734336)>, <Thread(Rabbit-heartbeat, started daemon 123319184174656)>, <Thread(Thread-5 (_runner), started daemon 123319183528384)>, <Thread(Thread-7 (_runner), started daemon 123319183663360)>] {{(pid=76785) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_service.periodic_task [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76785) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG cinder.volume.drivers.lvm [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Updating volume stats {{(pid=76785) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:10:35 devstack sudo[86165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 09 13:10:35 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:10:35 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:10:35 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:10:35 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:10:35 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:10:35 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:10:35 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 09 13:10:35 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:10:36 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Sep 09 13:10:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:10:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:10:36 devstack sudo[86177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 09 13:10:36 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:10:36 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root
Sep 09 13:10:36 devstack cinder-volume[76785]: DEBUG oslo_concurrency.processutils [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:10:36 devstack cinder-volume[76785]: DEBUG cinder.manager [None req-1a6db6f0-37f0-40c4-b261-fec565d9cfaa None None] Notifying Schedulers of capabilities ... {{(pid=76785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:10:48 devstack cinder-volume[76785]: DEBUG dbcounter [-] [76785] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:10:57 devstack cinder-volume[76624]: INFO oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Caught SIGTERM, stopping children
Sep 09 13:10:57 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Acquiring lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:10:57 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Acquired lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:10:57 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Releasing lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:10:57 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Stop services. {{(pid=76624) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 09 13:10:57 devstack cinder-volume[76624]: DEBUG oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Killing children. {{(pid=76624) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 09 13:10:57 devstack cinder-volume[76624]: INFO oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Waiting on 1 children to exit
Sep 09 13:11:02 devstack cinder-volume[76785]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Acquiring lock "singleton_lock" {{(pid=76785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:11:02 devstack cinder-volume[76785]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Acquired lock "singleton_lock" {{(pid=76785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:11:02 devstack cinder-volume[76785]: DEBUG oslo_concurrency.lockutils [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Releasing lock "singleton_lock" {{(pid=76785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:11:02 devstack cinder-volume[76785]: WARNING amqp [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 13:11:02 devstack cinder-volume[76785]: WARNING amqp [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 13:11:02 devstack cinder-volume[76624]: INFO oslo_service.backend._eventlet.service [None req-9328b58b-81cb-4dce-af56-6aac273bf756 None None] Child 76785 exited with status 0
Sep 09 13:11:02 devstack cinder-volume[86774]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 13:11:02 devstack cinder-volume[86774]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 13:11:02 devstack cinder-volume[86774]: we strongly recommend against using it for new projects.
Sep 09 13:11:02 devstack cinder-volume[86774]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 13:11:02 devstack cinder-volume[86774]: framework.  For more detail see
Sep 09 13:11:02 devstack cinder-volume[86774]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 13:11:02 devstack cinder-volume[86774]:   import eventlet  # noqa
Sep 09 13:11:04 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:11:04 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:11:04 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:11:05 devstack cinder-volume[86774]: INFO dbcounter [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Registered counter for database cinder
Sep 09 13:11:05 devstack cinder-volume[86774]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86774) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:05 devstack cinder-volume[86774]: DEBUG dbcounter [-] [86774] Writer thread running {{(pid=86774) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:11:05 devstack cinder-volume[86774]: INFO cinder.rpc [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 13:11:05 devstack cinder-volume[86774]: INFO cinder.rpc [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 13:11:05 devstack cinder-volume[86774]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86774) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:05 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Determined volume DB was empty at startup.
Sep 09 13:11:05 devstack cinder-volume[86774]: DEBUG cinder.volume.manager [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86774) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 13:11:05 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 09 13:11:05 devstack cinder-volume[86774]: WARNING stevedore.named [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 13:11:05 devstack cinder-volume[86774]: WARNING castellan.key_manager [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:11:05 devstack cinder-volume[86774]: WARNING cinder.keymgr.conf_key_mgr [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:11:06 devstack cinder-volume[86774]: INFO cinder.volume.manager [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86774) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:06 devstack cinder-volume[86774]: INFO oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Starting 1 workers
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Started child 87024 {{(pid=86774) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Full set of CONF: {{(pid=86774) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] ******************************************************************************** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Configuration options gathered from: {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] ================================================================================ {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] allow_availability_zone_fallback = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] allow_compression_on_image_upload = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] allowed_direct_url_schemes     = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] api_rate_limit                 = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] auth_strategy                  = keystone {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_availability_zone      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_host                   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[87024]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_name                   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_stats_polling_interval = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backup_api_class               = cinder.backup.api.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backup_name_template           = backup-%s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backup_use_same_host           = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backup_use_temp_snapshot       = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] chap_password                  = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] chap_username                  =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_internal_tenant_project_id = 261e13d4c2d34f218e49bb6ced3a2169 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_internal_tenant_user_id = 0f82fc0b29e3442e8c73d6f4dc21820b {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cluster                        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] compression_format             = gzip {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] config_dir                     = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] config_source                  = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] control_exchange               = openstack {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] debug                          = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] default_availability_zone      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] default_group_type             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] default_volume_type            = QuobyteHD {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] disk_geometry                  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_client_cert             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_client_cert_key         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_data_namespace          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_ssl_cert_path           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_ssl_cert_verify         = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] driver_use_ssl                 = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] enable_new_services            = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] enable_unsupported_driver      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] enforce_multipath_for_image_xfer = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] filter_function                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_api_insecure            = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_api_servers             = ['http://192.168.122.110/image'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_api_ssl_compression     = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_ca_certificates_file    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_certfile                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_keyfile                 = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_num_retries             = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance_request_timeout         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] goodness_function              = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] graceful_shutdown_timeout      = 5 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] group_api_class                = cinder.group.api.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] host                           = devstack {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_compress_on_upload       = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_conversion_address_space_limit = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_conversion_cpu_limit     = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_conversion_disable       = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_upload_use_cinder_backend = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_upload_use_internal_tenant = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_volume_cache_enabled     = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_volume_cache_max_count   = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] image_volume_cache_max_size_gb = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] init_host_max_objects_retrieval = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iscsi_target_flags             =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iscsi_write_cache              = on {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iser_helper                    = tgtadm {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iser_ip_address                = 192.168.122.110 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iser_port                      = 3260 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_color                      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_config_append              = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_dir                        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_file                       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_options                    = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_rotate_interval            = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_rotate_interval_type       = days {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] log_rotation_type              = none {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] max_age                        = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] max_logfile_count              = 30 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] max_logfile_size_mb            = 200 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] max_over_subscription_ratio    = 20.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] message_reap_interval          = 86400 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] message_ttl                    = 2592000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] migration_create_volume_timeout_secs = 300 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] monkey_patch                   = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] monkey_patch_modules           = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] my_ip                          = 192.168.122.110 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] no_snapshot_gb_quota           = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] num_iser_scan_tries            = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] num_shell_tries                = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] num_volume_device_scan_tries   = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] nvmeof_conn_info_version       = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] nvmet_ns_id                    = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] nvmet_port_id                  = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_max_limit                = 1000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_ext_list          = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_listen_port       = 8776 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_use_ssl           = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] osapi_volume_workers           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] per_volume_size_limit          = -1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] periodic_fuzzy_delay           = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] periodic_interval              = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] public_endpoint                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.remotefs [None req-7634d590-e289-4582-9bef-0c456be0559d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87024) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] publish_errors                 = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_backup_gigabytes         = 1000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_backups                  = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_gigabytes                = 1000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_groups                   = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_snapshots                = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] quota_volumes                  = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] rate_limit_burst               = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] rate_limit_except_level        = CRITICAL {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] rate_limit_interval            = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] reinit_driver_count            = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] replication_device             = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] report_discard_supported       = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] report_interval                = 120 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] reservation_clean_interval     = 86400 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] reservation_expire             = 86400 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] reserved_image_namespaces      = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] reserved_percentage            = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] rpc_response_timeout           = 120 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] run_external_periodic_tasks    = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] scst_target_driver             = iscsi {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] scst_target_iqn_name           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_down_time              = 720 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] shell_completion               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] snapshot_name_template         = snapshot-%s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] split_loggers                  = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] state_path                     = /opt/stack/data/cinder {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] storage_availability_zone      = nova {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] storage_protocol               = iSCSI {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] syslog_log_facility            = LOG_USER {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_helper                  = lioadm {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_ip_address              = 192.168.122.110 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_port                    = 3260 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_protocol                = iscsi {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] target_secondary_ip_addresses  = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] trace_flags                    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] transport_url                  = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] until_refresh                  = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_chap_auth                  = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_default_quota_class        = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_journal                    = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_json                       = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_multipath_for_image_xfer   = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_stderr                     = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] use_syslog                     = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] verify_glance_signatures       = enabled {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_api_class               = cinder.volume.api.API {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_backend_name            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_clear                   = zero {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_clear_ionice            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_clear_size              = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_copy_bps_limit          = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_dd_blocksize            = 1M {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_name_template           = volume-%s {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_service_inithost_offload = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volume_usage_audit_period      = month {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] zoning_mode                    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_concurrency.disable_process_locking = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.auth_section = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.auth_type   = password {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.auth_version = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.cache       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.certfile    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.include_service_catalog = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.insecure    = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.interface   = public {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.keyfile     = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_password = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcache_username = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.region_name = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.service_type = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.backend                  = dogpile.cache.null {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.backend_argument         = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.backend_expiration_time  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.config_prefix            = cache.oslo {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.debug_cache_backend      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.enable_retry_client      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.enable_socket_keepalive  = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.enabled                  = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.expiration_time          = 600 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.hashclient_retry_attempts = 2 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_dead_retry      = 300 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_sasl_enabled    = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.password                 = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.proxies                  = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.redis_db                 = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.redis_server             = localhost:6379 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.retry_attempts           = 2 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.retry_delay              = 0.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.socket_keepalive_count   = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.socket_keepalive_idle    = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.socket_keepalive_interval = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.socket_timeout           = 1.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.tls_allowed_ciphers      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.tls_cafile               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.tls_certfile             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.tls_enabled              = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.tls_keyfile              = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cache.username                 = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] coordination.backend_url       = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.asyncio_connection    = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.asyncio_slave_connection = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.backend               = sqlalchemy {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.connection            = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.connection_debug      = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.connection_parameters =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.connection_recycle_time = 3600 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.connection_trace      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.db_inc_retry_interval = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.db_max_retries        = 20 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.db_max_retry_interval = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.db_retry_interval     = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.max_overflow          = 50 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.max_pool_size         = 5 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.max_retries           = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.mysql_wsrep_sync_wait = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.pool_timeout          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.retry_interval        = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.slave_connection      = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.sqlite_synchronous    = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.synchronous_reader    = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] database.use_db_reconnect      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_tracing.insecure = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.connection_string     = messaging:// {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.enabled               = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.es_doc_type           = notification {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.es_scroll_size        = 10000 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.es_scroll_time        = 2m {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.filter_error_trace    = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.hmac_keys             = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.sentinel_service_name = mymaster {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.socket_timeout        = 0.1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.trace_requests        = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler.trace_sqlalchemy      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler_jaeger.process_tags   = {} {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler_jaeger.service_name_prefix = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] profiler_otlp.service_name_prefix = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.enforce_new_defaults = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.policy_default_rule = default {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87024) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 09 13:11:06 devstack cinder-volume[87024]: WARNING cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 09 13:11:06 devstack cinder-volume[87024]: WARNING cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Running cmd (subprocess): mount.quobyte {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.group          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.helper_command = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] privsep_osbrick.user           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.group         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.helper_command = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] cinder_sys_admin.user          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.auth_section      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.auth_type         = password {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.cafile            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.certfile          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.collect_timing    = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.insecure          = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.keyfile           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.send_service_user_token = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.split_loggers     = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.timeout           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.tls_ciphers       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] service_user.tls_min_version   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.auth_section            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.auth_type               = password {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.certfile                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.collect_timing          = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.insecure                = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.keyfile                 = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.region_name             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.split_loggers           = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.timeout                 = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.tls_ciphers             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] glance.tls_min_version         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.backend_availability_zone = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.chap_password = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.chap_username =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.disk_geometry = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_client_cert = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_client_cert_key = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_data_namespace = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.driver_use_ssl = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.extra_capabilities = {} {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.filter_function = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.goodness_function = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iscsi_target_flags =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iscsi_write_cache = on {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iser_port     = 3260 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_host      =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_login     = admin {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_mount_options = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_password  = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_private_key =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_share_path =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.num_shell_tries = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.quobyte_volume_url = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.replication_device = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.report_discard_supported = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.reserved_percentage = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_helper = tgtadm {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack quobyte-client[87027]: Reading configuration file: /etc/quobyte/client.cfg
Sep 09 13:11:06 devstack quobyte-client[87027]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_port   = 3260 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_protocol = iscsi {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.trace_flags   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.unique_fqdn_network = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.use_chap_auth = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_backend_name = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_clear  = zero {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_clear_ionice = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_clear_size = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: INFO cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 ...
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_reports.file_event_handler = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_reports.log_dir           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.backend_availability_zone = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.backend_host         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c -c /etc/quobyte/client-cinder.cfg {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.chap_password        = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.chap_username        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.disk_geometry        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_client_cert   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_data_namespace = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.extra_capabilities   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.filter_function      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.goodness_function    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iser_helper          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iser_ip_address      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iser_port            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_host             = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_login            = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_mount_options    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_password         = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_private_key      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_share_path       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.num_shell_tries      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.replication_device   = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.report_discard_supported = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.reserved_percentage  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.scst_target_driver   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.storage_protocol     = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_helper        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_ip_address    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_port          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_prefix        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_protocol      = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.trace_flags          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.use_chap_auth        = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_clear         = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_clear_size    = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] QuobyteHD.volumes_dir          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_notifications.driver = [] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_notifications.retry = -1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c -c /etc/quobyte/client-cinder.cfg
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] key_manager.fixed_key          = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.barbican_api_version  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.barbican_endpoint     = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.barbican_endpoint_type = public {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.barbican_region_name  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.cafile                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.certfile              = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.collect_timing        = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.insecure              = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.keyfile               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.number_of_retries     = 60 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.retry_delay           = 1 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.send_service_user_token = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.split_loggers         = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.timeout               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.tls_ciphers           = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.tls_min_version       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.verify_ssl            = True {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican.verify_ssl_path       = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.auth_section = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.auth_type = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.cafile   = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.certfile = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.collect_timing = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.insecure = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.keyfile  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.split_loggers = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.timeout  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.tls_ciphers = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] barbican_service_user.tls_min_version = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.approle_role_id          = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.approle_secret_id        = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.auth_method              = approle {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.auth_path                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.kv_mountpoint            = secret {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.kv_path                  = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.kv_version               = 2 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.namespace                = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.root_token_id            = **** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.ssl_ca_crt_file          = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.timeout                  = 60.0 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.token_file               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.token_role               = None {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.use_ssl                  = False {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:06 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] ******************************************************************************** {{(pid=86774) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 13:11:06 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.415s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:06 devstack cinder-volume[87024]: INFO cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 succeeded
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.439s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:06 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:06 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:06 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:07 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.234s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.volume.driver [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.volume.driver [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3740043640137, 'free_capacity_gb': 1773.3740043640137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87024) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_db.sqlalchemy.engines [None req-7634d590-e289-4582-9bef-0c456be0559d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG dbcounter [-] [87024] Writer thread running {{(pid=87024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.db.api [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Building query based on filter {{(pid=87024) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.image.image_utils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87024) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.keymgr.migration [None req-14f374ff-fc88-41bb-9a07-d98773eafa03 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:07 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:07 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:07 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.247s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Notifying Schedulers of capabilities ... {{(pid=87024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Driver initialization completed successfully.
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Initiating service 3 cleanup
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Service 3 cleanup completed.
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.service [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Creating RPC server for service cinder-volume {{(pid=87024) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.service [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87024) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 13:11:07 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:07 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:07 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:07 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:07 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-7634d590-e289-4582-9bef-0c456be0559d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.265s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:08 devstack cinder-volume[87024]: INFO cinder.volume.manager [None req-7634d590-e289-4582-9bef-0c456be0559d None None] Driver post RPC initialization completed successfully.
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG cinder.volume.drivers.quobyte [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:12 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:12 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:12 devstack cinder-volume[86774]: INFO oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Caught SIGTERM, stopping children
Sep 09 13:11:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Acquiring lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:11:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Acquired lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:11:12 devstack cinder-volume[86774]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Releasing lock "singleton_lock" {{(pid=86774) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:11:12 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Stop services. {{(pid=86774) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 09 13:11:12 devstack cinder-volume[86774]: DEBUG oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Killing children. {{(pid=86774) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 09 13:11:12 devstack cinder-volume[86774]: INFO oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Waiting on 1 children to exit
Sep 09 13:11:12 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG oslo_concurrency.processutils [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.341s {{(pid=87024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:12 devstack cinder-volume[87024]: DEBUG cinder.manager [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Notifying Schedulers of capabilities ... {{(pid=87024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo.messaging._drivers.impl_rabbit [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo.messaging._drivers.impl_rabbit [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server [None req-103dd8ab-60e6-4795-beae-ec53a7cbb606 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     method()
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return _publish(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     listener(*args)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server 
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server 
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self.transport._send(
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 09 13:11:12 devstack cinder-volume[87024]: ERROR oslo_messaging.rpc.server 
Sep 09 13:11:15 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Acquiring lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:11:15 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Acquired lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:11:15 devstack cinder-volume[87024]: DEBUG oslo_concurrency.lockutils [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Releasing lock "singleton_lock" {{(pid=87024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:11:15 devstack cinder-volume[87024]: WARNING amqp [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 13:11:15 devstack cinder-volume[87024]: WARNING amqp [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 09 13:11:15 devstack cinder-volume[86774]: INFO oslo_service.backend._eventlet.service [None req-e22e515e-63fb-492e-8c11-4fb5dd560533 None None] Child 87024 exited with status 0
Sep 09 13:11:16 devstack cinder-volume[87310]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 09 13:11:16 devstack cinder-volume[87310]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 13:11:16 devstack cinder-volume[87310]: we strongly recommend against using it for new projects.
Sep 09 13:11:16 devstack cinder-volume[87310]: If you are already using Eventlet, we recommend migrating to a different
Sep 09 13:11:16 devstack cinder-volume[87310]: framework.  For more detail see
Sep 09 13:11:16 devstack cinder-volume[87310]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 13:11:16 devstack cinder-volume[87310]:   import eventlet  # noqa
Sep 09 13:11:19 devstack cinder-volume[87310]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 09 13:11:19 devstack cinder-volume[87310]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 09 13:11:19 devstack cinder-volume[87310]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO dbcounter [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Registered counter for database cinder
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_db.sqlalchemy.engines [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG dbcounter [-] [87310] Writer thread running {{(pid=87310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO cinder.rpc [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO cinder.rpc [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_db.sqlalchemy.engines [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO cinder.volume.manager [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Determined volume DB was empty at startup.
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG cinder.volume.manager [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87310) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 09 13:11:20 devstack cinder-volume[87310]: WARNING stevedore.named [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 09 13:11:20 devstack cinder-volume[87310]: WARNING castellan.key_manager [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:11:20 devstack cinder-volume[87310]: WARNING cinder.keymgr.conf_key_mgr [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO cinder.volume.manager [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_db.sqlalchemy.engines [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:20 devstack cinder-volume[87310]: INFO oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Starting 1 workers
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Started child 87606 {{(pid=87310) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Full set of CONF: {{(pid=87310) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] ******************************************************************************** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] Configuration options gathered from: {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] ================================================================================ {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] allow_availability_zone_fallback = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] allow_compression_on_image_upload = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] allowed_direct_url_schemes     = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] api_rate_limit                 = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] auth_strategy                  = keystone {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_availability_zone      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87606]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_host                   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_name                   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_stats_polling_interval = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backup_api_class               = cinder.backup.api.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backup_name_template           = backup-%s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backup_use_same_host           = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backup_use_temp_snapshot       = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] chap_password                  = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] chap_username                  =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_internal_tenant_project_id = 261e13d4c2d34f218e49bb6ced3a2169 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_internal_tenant_user_id = 0f82fc0b29e3442e8c73d6f4dc21820b {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cluster                        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] compression_format             = gzip {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] compute_api_class              = cinder.compute.nova.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] config_dir                     = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] config_source                  = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] control_exchange               = openstack {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] debug                          = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] default_availability_zone      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] default_group_type             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] default_volume_type            = QuobyteHD {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] disk_geometry                  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_client_cert             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_client_cert_key         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_data_namespace          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_ssl_cert_path           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_ssl_cert_verify         = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] driver_use_ssl                 = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] enable_new_services            = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] enable_unsupported_driver      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] enabled_backends               = ['QuobyteHD'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] enforce_multipath_for_image_xfer = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] filter_function                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_api_insecure            = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_api_servers             = ['http://192.168.122.110/image'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_api_ssl_compression     = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_ca_certificates_file    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_catalog_info            = image:glance:publicURL {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_certfile                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_keyfile                 = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_num_retries             = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance_request_timeout         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] goodness_function              = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] graceful_shutdown_timeout      = 5 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] group_api_class                = cinder.group.api.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] host                           = devstack {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_compress_on_upload       = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_conversion_address_space_limit = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_conversion_cpu_limit     = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_conversion_disable       = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_upload_use_cinder_backend = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_upload_use_internal_tenant = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_volume_cache_enabled     = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_volume_cache_max_count   = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] image_volume_cache_max_size_gb = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] init_host_max_objects_retrieval = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] instance_format                = [instance: %(uuid)s]  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iscsi_target_flags             =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iscsi_write_cache              = on {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iser_helper                    = tgtadm {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iser_ip_address                = 192.168.122.110 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iser_port                      = 3260 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_color                      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_config_append              = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_dir                        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_file                       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_options                    = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87606) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_rotate_interval            = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_rotate_interval_type       = days {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] log_rotation_type              = none {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] max_age                        = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] max_logfile_count              = 30 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] max_logfile_size_mb            = 200 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] max_over_subscription_ratio    = 20.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] message_reap_interval          = 86400 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] message_ttl                    = 2592000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] migration_create_volume_timeout_secs = 300 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] monkey_patch                   = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] monkey_patch_modules           = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] my_ip                          = 192.168.122.110 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] no_snapshot_gb_quota           = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] num_iser_scan_tries            = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] num_shell_tries                = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] num_volume_device_scan_tries   = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] nvmeof_conn_info_version       = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] nvmet_ns_id                    = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] nvmet_port_id                  = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_max_limit                = 1000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_ext_list          = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_listen_port       = 8776 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_use_ssl           = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] osapi_volume_workers           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] per_volume_size_limit          = -1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] periodic_fuzzy_delay           = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] periodic_interval              = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] public_endpoint                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] publish_errors                 = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_backup_gigabytes         = 1000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_backups                  = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:20 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_gigabytes                = 1000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_groups                   = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_snapshots                = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] quota_volumes                  = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] rate_limit_burst               = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] rate_limit_except_level        = CRITICAL {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] rate_limit_interval            = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] reinit_driver_count            = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] replication_device             = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] report_discard_supported       = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] report_interval                = 120 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] reservation_clean_interval     = 86400 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] reservation_expire             = 86400 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] reserved_image_namespaces      = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] reserved_percentage            = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] rpc_response_timeout           = 120 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] run_external_periodic_tasks    = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] scst_target_driver             = iscsi {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] scst_target_iqn_name           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_down_time              = 720 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] shell_completion               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] snapshot_name_template         = snapshot-%s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] split_loggers                  = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] state_path                     = /opt/stack/data/cinder {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] storage_availability_zone      = nova {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] storage_protocol               = iSCSI {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] syslog_log_facility            = LOG_USER {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_helper                  = lioadm {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_ip_address              = 192.168.122.110 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_port                    = 3260 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_protocol                = iscsi {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] target_secondary_ip_addresses  = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] trace_flags                    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] transport_url                  = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] until_refresh                  = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_chap_auth                  = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_default_quota_class        = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_journal                    = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_json                       = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_multipath_for_image_xfer   = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_stderr                     = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] use_syslog                     = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] verify_glance_signatures       = enabled {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_api_class               = cinder.volume.api.API {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_backend_name            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_clear                   = zero {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_clear_ionice            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87606) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 09 13:11:21 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_clear_size              = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_copy_bps_limit          = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_dd_blocksize            = 1M {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_name_template           = volume-%s {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_service_inithost_offload = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Running cmd (subprocess): mount.quobyte {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volume_usage_audit_period      = month {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] zoning_mode                    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_concurrency.disable_process_locking = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.auth_section = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.auth_type   = password {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.auth_version = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.cache       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.certfile    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.include_service_catalog = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.insecure    = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.interface   = public {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.keyfile     = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_password = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcache_username = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.region_name = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.service_type = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.backend                  = dogpile.cache.null {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.backend_argument         = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.backend_expiration_time  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.config_prefix            = cache.oslo {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.debug_cache_backend      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.enable_retry_client      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.enable_socket_keepalive  = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.enabled                  = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.expiration_time          = 600 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.hashclient_retry_attempts = 2 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_dead_retry      = 300 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_pool_maxsize    = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_sasl_enabled    = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.password                 = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.proxies                  = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.redis_db                 = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.redis_server             = localhost:6379 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.retry_attempts           = 2 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.retry_delay              = 0.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.socket_keepalive_count   = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.socket_keepalive_idle    = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.socket_keepalive_interval = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.socket_timeout           = 1.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.tls_allowed_ciphers      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.tls_cafile               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.tls_certfile             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.tls_enabled              = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.tls_keyfile              = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cache.username                 = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] coordination.backend_url       = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.asyncio_connection    = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.asyncio_slave_connection = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.backend               = sqlalchemy {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.connection            = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.connection_debug      = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.connection_parameters =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.connection_recycle_time = 3600 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.connection_trace      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.db_inc_retry_interval = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.db_max_retries        = 20 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.db_max_retry_interval = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.db_retry_interval     = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.max_overflow          = 50 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.max_pool_size         = 5 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.max_retries           = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.mysql_wsrep_sync_wait = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.pool_timeout          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.retry_interval        = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.slave_connection      = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.sqlite_synchronous    = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.synchronous_reader    = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] database.use_db_reconnect      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_tracing.insecure = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.connection_string     = messaging:// {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.enabled               = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.es_doc_type           = notification {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.es_scroll_size        = 10000 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack quobyte-client[87615]: Reading configuration file: /etc/quobyte/client.cfg
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.es_scroll_time        = 2m {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.filter_error_trace    = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.hmac_keys             = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.sentinel_service_name = mymaster {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack quobyte-client[87615]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.socket_timeout        = 0.1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.trace_requests        = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler.trace_sqlalchemy      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler_jaeger.process_tags   = {} {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler_jaeger.service_name_prefix = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] profiler_otlp.service_name_prefix = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.enforce_new_defaults = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.policy_default_rule = default {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.policy_file        = policy.yaml {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.group          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.helper_command = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] privsep_osbrick.user           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.group         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.helper_command = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] cinder_sys_admin.user          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.auth_section      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.auth_type         = password {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.cafile            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.certfile          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.collect_timing    = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.insecure          = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.keyfile           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.send_service_user_token = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.split_loggers     = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.timeout           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.tls_ciphers       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] service_user.tls_min_version   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.auth_section            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.auth_type               = password {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.certfile                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.collect_timing          = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.insecure                = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.keyfile                 = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.region_name             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.split_loggers           = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.timeout                 = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.tls_ciphers             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] glance.tls_min_version         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.backend_availability_zone = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.chap_password = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.chap_username =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.disk_geometry = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_client_cert = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_client_cert_key = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_data_namespace = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.driver_use_ssl = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.extra_capabilities = {} {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.filter_function = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.goodness_function = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iscsi_target_flags =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iscsi_write_cache = on {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iser_helper   = tgtadm {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iser_port     = 3260 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_host      =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_login     = admin {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_mount_options = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_password  = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_private_key =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_share_path =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.num_shell_tries = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack sudo[87616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.quobyte_volume_url = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.replication_device = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.report_discard_supported = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.reserved_percentage = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_helper = tgtadm {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_port   = 3260 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_protocol = iscsi {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.trace_flags   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.unique_fqdn_network = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.use_chap_auth = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_backend_name = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_clear  = zero {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_clear_ionice = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_clear_size = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_reports.file_event_handler = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_reports.log_dir           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.backend_availability_zone = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.backend_host         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.chap_password        = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.chap_username        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.chiscsi_conf         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.disk_geometry        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_client_cert   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_data_namespace = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.driver_use_ssl       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.extra_capabilities   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.filter_function      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.goodness_function    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iser_helper          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iser_ip_address      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iser_port            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.iser_target_prefix   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_host             = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_login            = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_mount_options    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_password         = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_private_key      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_share_path       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_ssh_port         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.num_shell_tries      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.nvmet_port_id        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.replication_device   = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.report_discard_supported = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.reserved_percentage  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.scst_target_driver   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.storage_protocol     = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_helper        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_ip_address    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_port          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_prefix        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_protocol      = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.trace_flags          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.use_chap_auth        = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_clear         = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_clear_size    = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] QuobyteHD.volumes_dir          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl      = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_notifications.driver = [] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_notifications.retry = -1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] key_manager.fixed_key          = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.barbican_api_version  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.barbican_endpoint     = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.barbican_endpoint_type = public {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.barbican_region_name  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.cafile                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.certfile              = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.collect_timing        = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.insecure              = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.keyfile               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.number_of_retries     = 60 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.retry_delay           = 1 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.send_service_user_token = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.split_loggers         = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.timeout               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.tls_ciphers           = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.tls_min_version       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.verify_ssl            = True {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican.verify_ssl_path       = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.auth_section = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.auth_type = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.cafile   = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.certfile = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.collect_timing = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.insecure = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.keyfile  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.split_loggers = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.timeout  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.tls_ciphers = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] barbican_service_user.tls_min_version = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.approle_role_id          = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.approle_secret_id        = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.auth_method              = approle {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.auth_path                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.kv_mountpoint            = secret {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.kv_path                  = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.kv_version               = 2 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.namespace                = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.root_token_id            = **** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.ssl_ca_crt_file          = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.timeout                  = 60.0 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.token_file               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.token_role               = None {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.use_ssl                  = False {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 09 13:11:21 devstack cinder-volume[87310]: DEBUG oslo_service.backend._eventlet.service [None req-68cc5f7a-df0f-4778-a521-276edbefed5f None None] ******************************************************************************** {{(pid=87310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 09 13:11:21 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.volume.driver [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Driver hasn't implemented _init_vendor_properties()
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.driver [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3740043640137, 'free_capacity_gb': 1773.3740043640137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87606) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_db.sqlalchemy.engines [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writer thread running {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.db.api [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Building query based on filter {{(pid=87606) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87606) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.keymgr.migration [None req-ab90aabf-d599-45a7-aefc-1ea73ccc87cd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 09 13:11:21 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:21 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:21 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.237s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Driver initialization completed successfully.
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Initiating service 3 cleanup
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Service 3 cleanup completed.
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.service [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Creating RPC server for service cinder-volume {{(pid=87606) start /opt/stack/cinder/cinder/service.py:231}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.service [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87606) start /opt/stack/cinder/cinder/service.py:237}}
Sep 09 13:11:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:11:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:11:21 devstack sudo[87640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:11:21 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:11:22 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root
Sep 09 13:11:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.235s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:11:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-66882318-b330-4d84-88f3-537df8fe1e9e None None] Driver post RPC initialization completed successfully.
Sep 09 13:11:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:11:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 6 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:11:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:11:30 devstack cinder-volume[87310]: DEBUG dbcounter [-] [87310] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:11:31 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:11:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:25 devstack sudo[88088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:12:25 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:25 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 6 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:12:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:12:40 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Flow 'volume_create_manager' (cf16fe1b-c483-4f63-bc3b-c1225cc6919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa740a4-882e-4f88-ae9d-45b6ecf7583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa740a4-882e-4f88-ae9d-45b6ecf7583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1333499777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dc5262-eeed-43b6-9b94-4ce3d04bb7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed608ddc46443eab06b784ef5ec4d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:12:41Z,use_quota=True,user_id='4fe18a60bb274d07a7dc888b9854e589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e502ba2-4e01-4475-b115-19208e460ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e502ba2-4e01-4475-b115-19208e460ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159e8020-23d7-47c1-aaf2-d77adae255c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159e8020-23d7-47c1-aaf2-d77adae255c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dc5262-eeed-43b6-9b94-4ce3d04bb7c9', 'volume_name': 'volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d75564-92a9-43fa-85d8-81a110bc789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d75564-92a9-43fa-85d8-81a110bc789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c045a1-d351-4608-aebc-e61dec8480e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Volume 51dc5262-eeed-43b6-9b94-4ce3d04bb7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9', 'volume_size': 1}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1333499777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dc5262-eeed-43b6-9b94-4ce3d04bb7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed608ddc46443eab06b784ef5ec4d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:12:41Z,use_quota=True,user_id='4fe18a60bb274d07a7dc888b9854e589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Creating volume 51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:12:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:12:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:41 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 1073741824
Sep 09 13:12:41 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:43 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 1073741824" returned: 0 in 1.995s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:43 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9
Sep 09 13:12:43 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:44 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" returned: 0 in 0.878s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] <== create_volume: return (3057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.065s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c045a1-d351-4608-aebc-e61dec8480e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d825045b-2a3b-4d89-8484-104b39703153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:44 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Volume volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 (51dc5262-eeed-43b6-9b94-4ce3d04bb7c9): created successfully
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d825045b-2a3b-4d89-8484-104b39703153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Flow 'volume_create_manager' (cf16fe1b-c483-4f63-bc3b-c1225cc6919b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:12:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3f3ecdc4-5e1d-4250-912b-78a99c8a05ce tempest-DeleteServersTestJSON-2099246709 None] Created volume successfully.
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Flow 'volume_create_manager' (620b0544-b91f-414a-b1b5-4b99ed636517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70793b5-9633-4792-a085-230f2714565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70793b5-9633-4792-a085-230f2714565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1901044590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a46c7a-38ca-469c-8f16-2d89f0c6c51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759d84b1f9d449eaa6de921153db5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:12:47Z,use_quota=True,user_id='8a22a4f0aac44b9b90291adc6654a352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38edfb04-46fb-4660-bc4e-0fecde0273f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38edfb04-46fb-4660-bc4e-0fecde0273f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79164a57-e4e7-4847-bc0b-72296d87716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79164a57-e4e7-4847-bc0b-72296d87716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a46c7a-38ca-469c-8f16-2d89f0c6c51d', 'volume_name': 'volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6790c9-557d-4874-ba2b-46c79ee41a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6790c9-557d-4874-ba2b-46c79ee41a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35da91d5-0618-44fc-945e-c522b4cf2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Volume f9a46c7a-38ca-469c-8f16-2d89f0c6c51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d', 'volume_size': 1}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1901044590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a46c7a-38ca-469c-8f16-2d89f0c6c51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759d84b1f9d449eaa6de921153db5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:12:47Z,use_quota=True,user_id='8a22a4f0aac44b9b90291adc6654a352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Creating volume f9a46c7a-38ca-469c-8f16-2d89f0c6c51d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:12:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:12:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:47 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d 1073741824
Sep 09 13:12:47 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:48 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d 1073741824" returned: 0 in 1.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:48 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d
Sep 09 13:12:48 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:49 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" returned: 0 in 0.617s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35da91d5-0618-44fc-945e-c522b4cf2f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cd331e-5f69-47e5-a9a9-214584abb19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:12:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Volume volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d (f9a46c7a-38ca-469c-8f16-2d89f0c6c51d): created successfully
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cd331e-5f69-47e5-a9a9-214584abb19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:12:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Flow 'volume_create_manager' (620b0544-b91f-414a-b1b5-4b99ed636517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:12:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-82517edd-bf25-4864-9778-ecec311e7611 tempest-VolumesAdminNegativeTest-1694354195 None] Created volume successfully.
Sep 09 13:12:51 devstack cinder-volume[87606]: WARNING py.warnings [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 09 13:12:51 devstack cinder-volume[87606]:   .first()
Sep 09 13:12:51 devstack cinder-volume[87606]: 
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfd4f2fd-34c9-4819-af6c-9832d11e44dd', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Acquiring lock "cinder-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "cinder-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:12:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-e6dfe531-00ce-4fdf-a446-18b40756be97 req-60494e88-bb7d-4c08-bc89-2f904cfccc0f tempest-DeleteServersTestJSON-2099246709 None] attachment_update completed successfully.
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Acquiring lock "cinder-quobyte-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:12:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "cinder-quobyte-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:12:51 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdx8eie6w/privsep.sock']
Sep 09 13:12:51 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdx8eie6w/privsep.sock
Sep 09 13:12:51 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 09 13:12:53 devstack cinder-volume[87606]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 09 13:12:53 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:53 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Spawned new privsep daemon via rootwrap
Sep 09 13:12:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Accepted privsep connection to /tmp/tmpdx8eie6w/privsep.sock {{(pid=87606) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 09 13:12:53 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 09 13:12:53 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 09 13:12:53 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 09 13:12:53 devstack cinder-volume[87606]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89221
Sep 09 13:12:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2e116-0c06-416d-9605-c3b1aaf3f2a3]: (2,) {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:12:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9633476-6ca8-46a9-bf37-e66c0dde0558]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:12:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:54 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d
Sep 09 13:12:54 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:54 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" returned: 0 in 0.593s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:54 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d
Sep 09 13:12:54 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:54 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "cinder-quobyte-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d" released by "delete_volume" :: held 3.188s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:12:55 devstack cinder-volume[87606]: WARNING cinder.quota [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:12:55 devstack cinder-volume[87606]: WARNING cinder.quota [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Created reservations ['ca083c6a-fdd8-4f40-8388-9a9372583bd1', 'b9ff32d9-47c4-4a0e-b2af-95ddefeb00fc', 'dee233a6-4d97-4f99-bb84-104fbb595ec6', '34659d72-8e10-4ff0-88e8-74d4a2f5e6ec'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:55 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:12:55 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:12:55 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:12:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Deleted volume successfully.
Sep 09 13:12:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0906ade7-b807-4da0-b994-98c36bbbc5b7 tempest-VolumesAdminNegativeTest-1694354195 None] Lock "cinder-f9a46c7a-38ca-469c-8f16-2d89f0c6c51d-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:12:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-66effb02-c434-4c35-bea8-92101fb77ec0 req-cbf8ff7b-e8c2-4be2-8551-a36f7d925325 tempest-DeleteServersTestJSON-2099246709 None] Terminate volume connection completed successfully.
Sep 09 13:12:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-66effb02-c434-4c35-bea8-92101fb77ec0 req-cbf8ff7b-e8c2-4be2-8551-a36f7d925325 tempest-DeleteServersTestJSON-2099246709 None] Deleting attachment cfd4f2fd-34c9-4819-af6c-9832d11e44dd. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "cinder-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "cinder-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "cinder-quobyte-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "cinder-quobyte-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96957f-81b5-4951-abb0-9fb9365c761e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:12:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:12:59 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9
Sep 09 13:12:59 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:00 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" returned: 0 in 0.516s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:00 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9
Sep 09 13:13:00 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:00 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" returned: 0 in 0.361s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "cinder-quobyte-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9" released by "delete_volume" :: held 0.937s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Created reservations ['0326b2c3-0bba-4321-bd54-89f78eab1c01', '6618639c-5f15-4c6b-8c86-9819c26d1eb7', 'c8c68f8c-5671-4a46-8753-15dd8d42799b', 'e5a35990-e3c0-4ba3-9062-1ac2c1072c49'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:00 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:13:00 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:01 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:01 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:13:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Deleted volume successfully.
Sep 09 13:13:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-21a3e7be-d7d2-4057-8d9e-94590cc691e4 tempest-DeleteServersTestJSON-2099246709 None] Lock "cinder-51dc5262-eeed-43b6-9b94-4ce3d04bb7c9-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (c87dc154-48d8-4f70-9adb-c2f2d529e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359627f-d225-4857-adb3-7bc2c51ef7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359627f-d225-4857-adb3-7bc2c51ef7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-768307588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed84bea-4168-4bdb-9320-e576ba5eb98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:13:04Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe280b-87a5-449f-b8f4-2f129dab52f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe280b-87a5-449f-b8f4-2f129dab52f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960b5296-1720-4e7b-886b-a3e06cc7647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960b5296-1720-4e7b-886b-a3e06cc7647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed84bea-4168-4bdb-9320-e576ba5eb98d', 'volume_name': 'volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432c567d-ee10-465c-9c8d-07b9f4fd5da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432c567d-ee10-465c-9c8d-07b9f4fd5da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0eefbb-f7ba-417a-a65e-8d4fe2088172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Volume 4ed84bea-4168-4bdb-9320-e576ba5eb98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d', 'volume_size': 1}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-768307588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed84bea-4168-4bdb-9320-e576ba5eb98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:13:04Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Creating volume 4ed84bea-4168-4bdb-9320-e576ba5eb98d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:13:03 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:13:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:03 devstack sudo[89335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d 1073741824
Sep 09 13:13:03 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:04 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d 1073741824" returned: 0 in 0.537s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:04 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d
Sep 09 13:13:04 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:04 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0eefbb-f7ba-417a-a65e-8d4fe2088172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389bda0a-7447-47fe-9ffa-ddf266141e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:04 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Volume volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d (4ed84bea-4168-4bdb-9320-e576ba5eb98d): created successfully
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389bda0a-7447-47fe-9ffa-ddf266141e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (c87dc154-48d8-4f70-9adb-c2f2d529e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:13:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c5ddc192-9a84-4b64-b7ec-bdc390a60131 tempest-AttachVolumeTestJSON-513932895 None] Created volume successfully.
Sep 09 13:13:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5c081d0c-9429-418c-b625-07be315a7d56 req-58e954f8-df13-48dc-8f8f-41bcc738d55e tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5c081d0c-9429-418c-b625-07be315a7d56 req-58e954f8-df13-48dc-8f8f-41bcc738d55e tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5c081d0c-9429-418c-b625-07be315a7d56 req-58e954f8-df13-48dc-8f8f-41bcc738d55e tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-5c081d0c-9429-418c-b625-07be315a7d56 req-58e954f8-df13-48dc-8f8f-41bcc738d55e tempest-AttachVolumeTestJSON-513932895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '449819a9-4f8e-4804-8648-24aa3ac8de0c', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:13:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-5c081d0c-9429-418c-b625-07be315a7d56 req-58e954f8-df13-48dc-8f8f-41bcc738d55e tempest-AttachVolumeTestJSON-513932895 None] attachment_update completed successfully.
Sep 09 13:13:16 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=4,cinder:SELECT=27 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:13:16 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=33,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:25 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:13:25 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:25 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.471s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 8 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:13:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:13:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:13:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-b8596f9a-1e41-4d42-babc-cffeabdef835 req-0742e32c-1747-47a6-81df-62af5f8d11a0 tempest-AttachVolumeTestJSON-513932895 None] Terminate volume connection completed successfully.
Sep 09 13:13:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-b8596f9a-1e41-4d42-babc-cffeabdef835 req-0742e32c-1747-47a6-81df-62af5f8d11a0 tempest-AttachVolumeTestJSON-513932895 None] Deleting attachment 449819a9-4f8e-4804-8648-24aa3ac8de0c. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Flow 'volume_create_manager' (dbbed323-6778-4907-8680-3315345ab2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a07ed09-96a8-4f47-af82-bcc854d899d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a07ed09-96a8-4f47-af82-bcc854d899d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2047407335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10115a09d83845de85e98586c9bee4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:13:47Z,use_quota=True,user_id='1da060703f7a41619fcc16926c372792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae0da96-d58c-4c82-8b8c-d844b6056987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae0da96-d58c-4c82-8b8c-d844b6056987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f011ebd-a6cd-444b-b1f0-4ff92933f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f011ebd-a6cd-444b-b1f0-4ff92933f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e', 'volume_name': 'volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d9e0b0-acec-435f-9a31-94f5d9b727bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d9e0b0-acec-435f-9a31-94f5d9b727bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db09fa1-4031-40da-b050-4577c337df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Volume dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e', 'volume_size': 1}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2047407335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10115a09d83845de85e98586c9bee4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:13:47Z,use_quota=True,user_id='1da060703f7a41619fcc16926c372792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Creating volume dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:13:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:13:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:47 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e 1073741824
Sep 09 13:13:47 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:48 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e 1073741824" returned: 0 in 1.131s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:13:48 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e
Sep 09 13:13:48 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:13:48 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Sep 09 13:13:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" returned: 0 in 0.508s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:13:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:13:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:13:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db09fa1-4031-40da-b050-4577c337df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72a3f87-ac79-40b8-8888-25d0292f7250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:13:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Volume volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e (dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e): created successfully
Sep 09 13:13:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72a3f87-ac79-40b8-8888-25d0292f7250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:13:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Flow 'volume_create_manager' (dbbed323-6778-4907-8680-3315345ab2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:13:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4b0f0826-331f-444d-89bd-80f286fc7921 tempest-ServerRescueNegativeTestJSON-2020898197 None] Created volume successfully.
Sep 09 13:13:59 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:13:59 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:14:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Acquiring lock "cinder-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "cinder-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Acquiring lock "cinder-quobyte-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "cinder-quobyte-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5947ca-293b-4120-a18f-f973689cff6e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:11 devstack sudo[91009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e
Sep 09 13:14:11 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:11 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" returned: 0 in 0.447s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:11 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e
Sep 09 13:14:11 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:11 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "cinder-quobyte-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e" released by "delete_volume" :: held 0.890s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Created reservations ['1e5e36eb-f542-41b0-9adc-07a73ac01822', 'b4fb04d3-38d5-4d22-916d-0b951b6109bc', '7d61045d-f35e-42eb-8c59-4e3a43e05c46', 'cf910022-638e-4317-878a-da43ac8f8316'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:12 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:14:12 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:12 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:14:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Deleted volume successfully.
Sep 09 13:14:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a2a0da9f-bb9f-4a20-94b0-6fc35843209e tempest-ServerRescueNegativeTestJSON-2020898197 None] Lock "cinder-dda9eaf1-c6b9-4099-a2c0-ab70d3029a7e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:19 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Flow 'volume_create_manager' (9d2f5a89-7c08-4f98-8d5d-fb2bad9a9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5325dc4-f3d3-42fa-b8e4-ef82d610712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5325dc4-f3d3-42fa-b8e4-ef82d610712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1972307241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af43312d-8f8d-4775-bc0b-240f5c34bc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb12f8bfb2cc4add909bf8dd23934b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:20Z,use_quota=True,user_id='c9e9d55876bb469c87ceae08a8d424e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254ea7ea-5dd8-4dc6-ad7e-8003e2f5c23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254ea7ea-5dd8-4dc6-ad7e-8003e2f5c23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a676c04-beb3-49e2-acbc-537457079b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a676c04-beb3-49e2-acbc-537457079b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af43312d-8f8d-4775-bc0b-240f5c34bc03', 'volume_name': 'volume-af43312d-8f8d-4775-bc0b-240f5c34bc03', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a87d9-83f3-440e-8fed-fe3250683fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a87d9-83f3-440e-8fed-fe3250683fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471003a4-06fb-4f15-8ede-32ba08a9ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Volume af43312d-8f8d-4775-bc0b-240f5c34bc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af43312d-8f8d-4775-bc0b-240f5c34bc03', 'volume_size': 1}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1972307241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af43312d-8f8d-4775-bc0b-240f5c34bc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb12f8bfb2cc4add909bf8dd23934b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:20Z,use_quota=True,user_id='c9e9d55876bb469c87ceae08a8d424e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Creating volume af43312d-8f8d-4775-bc0b-240f5c34bc03 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:20 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:20 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 1073741824
Sep 09 13:14:20 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:20 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 1073741824" returned: 0 in 0.486s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:20 devstack sudo[91112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03
Sep 09 13:14:20 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:20 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471003a4-06fb-4f15-8ede-32ba08a9ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af43312d-8f8d-4775-bc0b-240f5c34bc03', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b28f96-47ad-4a3d-b1cf-a80fc42ad5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Volume volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 (af43312d-8f8d-4775-bc0b-240f5c34bc03): created successfully
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b28f96-47ad-4a3d-b1cf-a80fc42ad5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Flow 'volume_create_manager' (9d2f5a89-7c08-4f98-8d5d-fb2bad9a9307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b12df115-9f77-4fa8-842c-e2fa8ee7c9cd tempest-TaggedAttachmentsTest-895492161 None] Created volume successfully.
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Flow 'volume_create_manager' (b80823a9-5a2d-4054-acc7-40fc38e8703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb85a9e-a2d9-4504-91cf-ef32f9cd9b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb85a9e-a2d9-4504-91cf-ef32f9cd9b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-80620492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7f172c-6133-49dd-a94e-8791d05ecb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa96b3fe8f554034ae5306287843536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:21Z,use_quota=True,user_id='c0d976fd9f9741dd944df5819d744adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda58fac-679e-41a0-ab7b-3f15b4bef26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda58fac-679e-41a0-ab7b-3f15b4bef26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8af7d5-d367-4d52-b98b-5a7897fcbf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8af7d5-d367-4d52-b98b-5a7897fcbf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7f172c-6133-49dd-a94e-8791d05ecb60', 'volume_name': 'volume-dd7f172c-6133-49dd-a94e-8791d05ecb60', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d71727f-c2ff-487b-b4ab-44b770bf3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d71727f-c2ff-487b-b4ab-44b770bf3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1bce7a-ded1-4333-82bd-857967765337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Volume dd7f172c-6133-49dd-a94e-8791d05ecb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7f172c-6133-49dd-a94e-8791d05ecb60', 'volume_size': 1}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-80620492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7f172c-6133-49dd-a94e-8791d05ecb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa96b3fe8f554034ae5306287843536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:21Z,use_quota=True,user_id='c0d976fd9f9741dd944df5819d744adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Creating volume dd7f172c-6133-49dd-a94e-8791d05ecb60 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:21 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:21 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 1073741824
Sep 09 13:14:21 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:21 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 1073741824" returned: 0 in 0.528s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:22 devstack sudo[91124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60
Sep 09 13:14:22 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:22 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60" returned: 0 in 0.297s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1bce7a-ded1-4333-82bd-857967765337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7f172c-6133-49dd-a94e-8791d05ecb60', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0652b8-650d-422e-8f5f-0f9b281c8309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Volume volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 (dd7f172c-6133-49dd-a94e-8791d05ecb60): created successfully
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0652b8-650d-422e-8f5f-0f9b281c8309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Flow 'volume_create_manager' (b80823a9-5a2d-4054-acc7-40fc38e8703c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-22d6298f-2b0b-4662-b394-dc7b8bd48c3f tempest-ServerActionsTestOtherA-1035948921 None] Created volume successfully.
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:25 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:14:25 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:25 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.344s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Flow 'volume_create_manager' (878077cb-d890-40a8-b7d3-4ccd79a1e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4158436c-7946-426d-9ef8-c7806be52e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4158436c-7946-426d-9ef8-c7806be52e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1717238744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54f9cfb-960f-4521-9440-6f15be2c9178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0481ab77e893445791bb35b317fefedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:29Z,use_quota=True,user_id='1ce4d554d0694ac1a2d20af8c28f6b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c80fbc1-5c47-4675-8603-25ccc137a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c80fbc1-5c47-4675-8603-25ccc137a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf8fb0-ae87-40ab-b3d3-7733c5753ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bf8fb0-ae87-40ab-b3d3-7733c5753ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54f9cfb-960f-4521-9440-6f15be2c9178', 'volume_name': 'volume-e54f9cfb-960f-4521-9440-6f15be2c9178', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f58e443-6eff-4b4c-b0fe-7c3edd604767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f58e443-6eff-4b4c-b0fe-7c3edd604767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04897c8-cabb-4c9d-84c0-a4aa067621f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Volume e54f9cfb-960f-4521-9440-6f15be2c9178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54f9cfb-960f-4521-9440-6f15be2c9178', 'volume_size': 1}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1717238744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54f9cfb-960f-4521-9440-6f15be2c9178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0481ab77e893445791bb35b317fefedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:29Z,use_quota=True,user_id='1ce4d554d0694ac1a2d20af8c28f6b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Creating volume e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:29 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:29 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 1073741824
Sep 09 13:14:29 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:30 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 1073741824" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:30 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178
Sep 09 13:14:30 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:30 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04897c8-cabb-4c9d-84c0-a4aa067621f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54f9cfb-960f-4521-9440-6f15be2c9178', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b589f1d7-2959-4a8c-935d-f9f5b78c9a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Volume volume-e54f9cfb-960f-4521-9440-6f15be2c9178 (e54f9cfb-960f-4521-9440-6f15be2c9178): created successfully
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b589f1d7-2959-4a8c-935d-f9f5b78c9a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Flow 'volume_create_manager' (878077cb-d890-40a8-b7d3-4ccd79a1e773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-db2671ac-aaa4-4926-a089-4ec756c46b82 req-14ca16d6-e0ab-47ec-8c01-3cf4442282a4 tempest-VolumesSnapshotsTestJSON-1217567549 None] Created volume successfully.
Sep 09 13:14:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Creating offline snapshot 4734babb-dc24-4926-88d4-0920ac55aeb6 of volume e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:14:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6b68a-d986-48d1-92a7-06b2a44d9102]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:31 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178
Sep 09 13:14:31 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:32 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178" returned: 0 in 0.627s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:32 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 1G
Sep 09 13:14:32 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:33 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 1G" returned: 0 in 0.738s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9cfb-960f-4521-9440-6f15be2c9178 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:33 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9cfb-960f-4521-9440-6f15be2c9178 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6
Sep 09 13:14:33 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:33 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9cfb-960f-4521-9440-6f15be2c9178 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6" returned: 0 in 0.503s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:33 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 is being set with open permissions: ugo+rw
Sep 09 13:14:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:33 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6
Sep 09 13:14:33 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:34 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6" returned: 0 in 0.504s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:34 devstack sudo[91325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info
Sep 09 13:14:34 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:34 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info" returned: 0 in 0.417s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:34 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info is being set with open permissions: ugo+rw
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:34 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info
Sep 09 13:14:34 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:34 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.info" returned: 0 in 0.420s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.420s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-7368c376-7349-4779-b076-52df20e7c544 req-bf1aa7b6-c11a-4afe-8811-c5993c10660a tempest-VolumesSnapshotsTestJSON-1217567549 None] Create snapshot completed successfully
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "cinder-4734babb-dc24-4926-88d4-0920ac55aeb6-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-4734babb-dc24-4926-88d4-0920ac55aeb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "cinder-quobyte-4734babb-dc24-4926-88d4-0920ac55aeb6" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-4734babb-dc24-4926-88d4-0920ac55aeb6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Deleting offline snapshot 4734babb-dc24-4926-88d4-0920ac55aeb6 of volume e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] snapshot_file for this snap is: volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63ec8a-90c8-4380-82c9-ed548a73762d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:35 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6
Sep 09 13:14:35 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:35 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6" returned: 0 in 0.512s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54f9cfb-960f-4521-9440-6f15be2c9178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:14:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6794bbb4-55c4-4020-a033-6a9499abbfdd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:36 devstack sudo[91339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178
Sep 09 13:14:36 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:36 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178" returned: 0 in 0.757s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:36 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6
Sep 09 13:14:36 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:37 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6" returned: 0 in 0.736s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:37 devstack sudo[91350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6
Sep 09 13:14:37 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:38 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178.4734babb-dc24-4926-88d4-0920ac55aeb6" returned: 0 in 0.669s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-4734babb-dc24-4926-88d4-0920ac55aeb6" released by "_delete_snapshot" :: held 2.867s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" released by "delete_snapshot" :: held 2.900s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:38 devstack cinder-volume[87606]: WARNING cinder.quota [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.quota [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Created reservations ['4f2b6f6a-8742-4705-9ced-9e64b52dad67', '6bee6638-4029-4bdb-97a4-8a3d12980d3d', '98f4b178-89e4-41ed-9a3f-434ae9d6e7c6', '6169fb9c-0f0c-40aa-8421-259d124fcb7e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:14:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Delete snapshot completed successfully.
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-c24fa0f1-1273-47ae-8e99-c596b4b2f1f6 req-9adfc9af-1682-4db0-85af-72e05b284ade tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-4734babb-dc24-4926-88d4-0920ac55aeb6-delete_snapshot" released by "delete_snapshot" :: held 3.170s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "cinder-e54f9cfb-960f-4521-9440-6f15be2c9178-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-e54f9cfb-960f-4521-9440-6f15be2c9178-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[efada518-1fed-4422-bb58-d4b619aa0434]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:39 devstack sudo[91359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178
Sep 09 13:14:39 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:39 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178" returned: 0 in 0.476s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:39 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178
Sep 09 13:14:39 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:39 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e54f9cfb-960f-4521-9440-6f15be2c9178" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-quobyte-e54f9cfb-960f-4521-9440-6f15be2c9178" released by "delete_volume" :: held 0.869s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG cinder.quota [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Created reservations ['f03d897a-69a3-487f-a06e-8dae58a31975', '605e099f-a84b-4932-b517-0311fde1ad33', 'ac0bcd00-9b1a-4e00-86d9-0ea452fcd0d0', 'd0b058d7-cf6f-4fba-9760-1e764c0af65c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:40 devstack sudo[91369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:14:40 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:40 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.447s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG cinder.manager [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:14:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Deleted volume successfully.
Sep 09 13:14:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-bc362b46-6233-4077-860a-f32cafd4af58 req-c46b6794-ef30-4be2-af12-09bb72f7758f tempest-VolumesSnapshotsTestJSON-1217567549 None] Lock "cinder-e54f9cfb-960f-4521-9440-6f15be2c9178-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (f0df6370-0b5e-44e7-b832-dc19c08f8a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bafc09d-7670-4e74-8b26-a6c7754a3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bafc09d-7670-4e74-8b26-a6c7754a3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-825699861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1751a68d-f75c-4ad2-a121-61ec0e7fe221,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:46Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbbde97-af59-4dfd-bbe5-95afd1541f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbbde97-af59-4dfd-bbe5-95afd1541f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25cb4d-d2e3-4731-b9a4-927fbc0c19c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25cb4d-d2e3-4731-b9a4-927fbc0c19c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1751a68d-f75c-4ad2-a121-61ec0e7fe221', 'volume_name': 'volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b91e46-a0be-461d-b600-5cd80dd87911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b91e46-a0be-461d-b600-5cd80dd87911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65df74a7-a7f8-4386-be77-0dc25dadd836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Volume 1751a68d-f75c-4ad2-a121-61ec0e7fe221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221', 'volume_size': 1}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-825699861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1751a68d-f75c-4ad2-a121-61ec0e7fe221,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:46Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Creating volume 1751a68d-f75c-4ad2-a121-61ec0e7fe221 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:46 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:46 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 1073741824
Sep 09 13:14:46 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:47 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 1073741824" returned: 0 in 0.754s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:47 devstack sudo[91408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221
Sep 09 13:14:47 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:47 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65df74a7-a7f8-4386-be77-0dc25dadd836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2a6e6a-abec-4fee-bc29-44cfb9b25940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Volume volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 (1751a68d-f75c-4ad2-a121-61ec0e7fe221): created successfully
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2a6e6a-abec-4fee-bc29-44cfb9b25940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (f0df6370-0b5e-44e7-b832-dc19c08f8a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-333fc1c3-aac3-4820-93c4-b535a7ca6b8b tempest-VolumesTestJSON-1418864606 None] Created volume successfully.
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (a03c731e-2603-4f83-8ead-9929554c95dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0b3ed7-bae2-4f28-bfab-ad9948d01380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0b3ed7-bae2-4f28-bfab-ad9948d01380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1268201611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6014b67c-f418-47f8-bb0c-1dfcd1d17c76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:50Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab1d5c-38ad-4fb5-970e-c998aa58a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab1d5c-38ad-4fb5-970e-c998aa58a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde713db-5767-4571-91c4-f6aabe00940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde713db-5767-4571-91c4-f6aabe00940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6014b67c-f418-47f8-bb0c-1dfcd1d17c76', 'volume_name': 'volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd6f3b-cbb8-4818-93c0-54ac6ea97a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd6f3b-cbb8-4818-93c0-54ac6ea97a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aae65eb-9aba-49bf-a568-7c1416c9bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Volume 6014b67c-f418-47f8-bb0c-1dfcd1d17c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76', 'volume_size': 1}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1268201611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6014b67c-f418-47f8-bb0c-1dfcd1d17c76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:50Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Creating volume 6014b67c-f418-47f8-bb0c-1dfcd1d17c76 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:49 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:49 devstack sudo[91467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 1073741824
Sep 09 13:14:49 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:50 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 1073741824" returned: 0 in 0.637s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:50 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76
Sep 09 13:14:50 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:50 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aae65eb-9aba-49bf-a568-7c1416c9bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f630a0-911e-4057-8aca-eb3f3d156beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:50 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Volume volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 (6014b67c-f418-47f8-bb0c-1dfcd1d17c76): created successfully
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f630a0-911e-4057-8aca-eb3f3d156beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (a03c731e-2603-4f83-8ead-9929554c95dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9ddc68be-a01c-4203-9f8e-a749aaba369a tempest-VolumesTestJSON-1418864606 None] Created volume successfully.
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (e22a35ff-a868-42dd-b96e-6435b55153d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da616b0-040f-476d-ab2d-7e001e984916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da616b0-040f-476d-ab2d-7e001e984916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235087348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d79521-7515-4087-8b09-8c2324093630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:52Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc46c35-2713-473c-90c3-7d41c2705c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc46c35-2713-473c-90c3-7d41c2705c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8584c6f-0864-4ee7-a84f-d4fd511bbe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8584c6f-0864-4ee7-a84f-d4fd511bbe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d79521-7515-4087-8b09-8c2324093630', 'volume_name': 'volume-d8d79521-7515-4087-8b09-8c2324093630', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32053064-df67-4d8f-95ec-a1ffa33ffa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32053064-df67-4d8f-95ec-a1ffa33ffa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ee4845-9654-4515-b015-22b0999bb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:52 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Volume d8d79521-7515-4087-8b09-8c2324093630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d79521-7515-4087-8b09-8c2324093630', 'volume_size': 1}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235087348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d79521-7515-4087-8b09-8c2324093630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e5c7078fc964b47956fc768c9ab643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:14:52Z,use_quota=True,user_id='d54b7816fae44034a060f342cae52e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Creating volume d8d79521-7515-4087-8b09-8c2324093630 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:14:52 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:52 devstack sudo[91481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 1073741824
Sep 09 13:14:52 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:52 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 1073741824" returned: 0 in 0.530s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:52 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630
Sep 09 13:14:52 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:53 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ee4845-9654-4515-b015-22b0999bb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d79521-7515-4087-8b09-8c2324093630', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9281c0-4d08-4885-895f-b829aa30d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:14:53 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Volume volume-d8d79521-7515-4087-8b09-8c2324093630 (d8d79521-7515-4087-8b09-8c2324093630): created successfully
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9281c0-4d08-4885-895f-b829aa30d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:14:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Flow 'volume_create_manager' (e22a35ff-a868-42dd-b96e-6435b55153d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:14:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-33dbb697-c13c-4dcc-be84-01e54655d4ca tempest-VolumesTestJSON-1418864606 None] Created volume successfully.
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-d8d79521-7515-4087-8b09-8c2324093630-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-d8d79521-7515-4087-8b09-8c2324093630-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-quobyte-d8d79521-7515-4087-8b09-8c2324093630" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-d8d79521-7515-4087-8b09-8c2324093630" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c7ed55-8ceb-4903-ac61-4dd86b33756e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:55 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630
Sep 09 13:14:55 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:56 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630" returned: 0 in 0.781s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:56 devstack sudo[91546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630
Sep 09 13:14:56 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:56 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8d79521-7515-4087-8b09-8c2324093630" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-d8d79521-7515-4087-8b09-8c2324093630" released by "delete_volume" :: held 1.404s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:56 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Created reservations ['df016369-6a0a-45b8-9166-d09fd903e2a4', '9a10a842-5196-4033-99aa-bbde4a1621aa', '7905782a-83c5-4121-824d-a754b9bf2052', '99d4455b-7baa-4ed9-a7f0-b2683bc161e7'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:57 devstack sudo[91581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:14:57 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-6014b67c-f418-47f8-bb0c-1dfcd1d17c76-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "cinder-6014b67c-f418-47f8-bb0c-1dfcd1d17c76-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-quobyte-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:14:57 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.643s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bcbed1-d0a7-4d8a-9b7e-d0b1b3ce3172]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Deleted volume successfully.
Sep 09 13:14:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-88cc7aa4-c5ee-4d89-9389-a68724d087a8 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-d8d79521-7515-4087-8b09-8c2324093630-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:57 devstack sudo[91588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76
Sep 09 13:14:57 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:58 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" returned: 0 in 0.558s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:58 devstack sudo[91598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76
Sep 09 13:14:58 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:58 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-6014b67c-f418-47f8-bb0c-1dfcd1d17c76" released by "delete_volume" :: held 1.041s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:58 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Created reservations ['2f6a0dd6-92e1-4fde-9400-0cf3f584251d', '119c6792-4c62-4a51-822b-54fc25144c13', 'dfa5d72b-00d7-41fe-84e4-dda3bbfb2b09', '54182094-fadb-499c-a92a-34677269a4aa'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:14:59 devstack sudo[91607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:14:59 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:14:59 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.316s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:14:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Deleted volume successfully.
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-48b997f7-0ad1-43df-9572-a8cdfe462a4b tempest-VolumesTestJSON-1418864606 None] Lock "cinder-6014b67c-f418-47f8-bb0c-1dfcd1d17c76-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-fc1e328e-0fb8-4ff1-b1c7-504224217207 req-d9c76fef-a581-4a01-a2f2-27ab52d14052 tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-fc1e328e-0fb8-4ff1-b1c7-504224217207 req-d9c76fef-a581-4a01-a2f2-27ab52d14052 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-fc1e328e-0fb8-4ff1-b1c7-504224217207 req-d9c76fef-a581-4a01-a2f2-27ab52d14052 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:14:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-fc1e328e-0fb8-4ff1-b1c7-504224217207 req-d9c76fef-a581-4a01-a2f2-27ab52d14052 tempest-ServerActionsTestOtherA-1035948921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-dd7f172c-6133-49dd-a94e-8791d05ecb60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a723d8ba-08c5-4f05-850c-41d6d52de248', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:14:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-fc1e328e-0fb8-4ff1-b1c7-504224217207 req-d9c76fef-a581-4a01-a2f2-27ab52d14052 tempest-ServerActionsTestOtherA-1035948921 None] attachment_update completed successfully.
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-1751a68d-f75c-4ad2-a121-61ec0e7fe221-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-1751a68d-f75c-4ad2-a121-61ec0e7fe221-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "cinder-quobyte-1751a68d-f75c-4ad2-a121-61ec0e7fe221" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-1751a68d-f75c-4ad2-a121-61ec0e7fe221" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[23618a74-c043-445d-b58c-12e6dc7790a6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:00 devstack sudo[91689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221
Sep 09 13:15:00 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:01 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221" returned: 0 in 0.802s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:01 devstack sudo[92011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221
Sep 09 13:15:01 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:01 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1751a68d-f75c-4ad2-a121-61ec0e7fe221" returned: 0 in 0.612s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-quobyte-1751a68d-f75c-4ad2-a121-61ec0e7fe221" released by "delete_volume" :: held 1.497s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Created reservations ['fe99cfa4-b9a2-4a05-934c-69ed84983532', '647f87b6-9267-4397-9949-1048209549af', 'ceddc55f-2d54-4215-9ee9-9d82b5b0931a', 'b68b2c31-e411-4432-a898-a79d0acd506e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:02 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:02 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:02 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Deleted volume successfully.
Sep 09 13:15:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9414239d-0a2a-4b37-ad89-9bac4e7030d2 tempest-VolumesTestJSON-1418864606 None] Lock "cinder-1751a68d-f75c-4ad2-a121-61ec0e7fe221-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-04a291fb-003f-431f-a450-ce7e7f33c6ea tempest-ServerActionsTestOtherA-1035948921 None] Terminate volume connection completed successfully.
Sep 09 13:15:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-04a291fb-003f-431f-a450-ce7e7f33c6ea tempest-ServerActionsTestOtherA-1035948921 None] Deleting attachment a723d8ba-08c5-4f05-850c-41d6d52de248. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:15:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-f19270e1-12d2-45c9-918f-c44b30c0f11c tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-f19270e1-12d2-45c9-918f-c44b30c0f11c tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-f19270e1-12d2-45c9-918f-c44b30c0f11c tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-f19270e1-12d2-45c9-918f-c44b30c0f11c tempest-ServerActionsTestOtherA-1035948921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-dd7f172c-6133-49dd-a94e-8791d05ecb60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06b0f05c-2a14-4b61-b37e-07b301277133', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:15:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-eb0434a1-5f96-4ee8-9819-c8308c8db5a3 req-f19270e1-12d2-45c9-918f-c44b30c0f11c tempest-ServerActionsTestOtherA-1035948921 None] attachment_update completed successfully.
Sep 09 13:15:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cc3635f3-39bc-43b1-83c6-3142c5c0ad98 req-219e0098-94c6-4d16-bb29-8ab7ed721736 tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cc3635f3-39bc-43b1-83c6-3142c5c0ad98 req-219e0098-94c6-4d16-bb29-8ab7ed721736 tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cc3635f3-39bc-43b1-83c6-3142c5c0ad98 req-219e0098-94c6-4d16-bb29-8ab7ed721736 tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-cc3635f3-39bc-43b1-83c6-3142c5c0ad98 req-219e0098-94c6-4d16-bb29-8ab7ed721736 tempest-TaggedAttachmentsTest-895492161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-af43312d-8f8d-4775-bc0b-240f5c34bc03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8befc4d5-494d-40ca-ad63-a98a9b506acd', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:15:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-cc3635f3-39bc-43b1-83c6-3142c5c0ad98 req-219e0098-94c6-4d16-bb29-8ab7ed721736 tempest-TaggedAttachmentsTest-895492161 None] attachment_update completed successfully.
Sep 09 13:15:11 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=69,cinder:SELECT=65,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:15:11 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=70,cinder:INSERT=14,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:15:11 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-f6062023-b7a5-4c71-ae35-d7f3911d8aaf req-4b068b7c-0387-4032-920d-0250b4c5ad53 tempest-TaggedAttachmentsTest-895492161 None] Terminate volume connection completed successfully.
Sep 09 13:15:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-f6062023-b7a5-4c71-ae35-d7f3911d8aaf req-4b068b7c-0387-4032-920d-0250b4c5ad53 tempest-TaggedAttachmentsTest-895492161 None] Deleting attachment 8befc4d5-494d-40ca-ad63-a98a9b506acd. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:15:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-571fb1c9-96cd-44b0-9a43-9ca1d0d3cf78 tempest-GroupsV314Test-702730711 None] Group tempest-GroupsV314Test-Group-1718845260: creating
Sep 09 13:15:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-571fb1c9-96cd-44b0-9a43-9ca1d0d3cf78 tempest-GroupsV314Test-702730711 None] Group tempest-GroupsV314Test-Group-1718845260: created successfully
Sep 09 13:15:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-571fb1c9-96cd-44b0-9a43-9ca1d0d3cf78 tempest-GroupsV314Test-702730711 None] Create group completed successfully.
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Flow 'volume_create_manager' (ffc59231-5930-47ac-bc46-9612b34944d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3325fa94-9f88-449a-af42-21833a802790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3325fa94-9f88-449a-af42-21833a802790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919000839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aba13b9f-15d5-47eb-a320-aa572dd38d55,host='devstack@QuobyteHD#QuobyteHD',id=cd6b616d-d24f-4254-9ed2-055f5935b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6c30092f5743338b9d5d8dd3ed67fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:14Z,use_quota=True,user_id='9e77e9bd58bf48c6a4f30f87661f53d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23421b17-3270-4b97-a701-d7167c4aa845),volume_type_id=23421b17-3270-4b97-a701-d7167c4aa845)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba20962-6113-4cc3-a0b8-e348ea0219f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba20962-6113-4cc3-a0b8-e348ea0219f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7155b3f0-2dde-473d-8315-bec83436f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7155b3f0-2dde-473d-8315-bec83436f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6b616d-d24f-4254-9ed2-055f5935b915', 'volume_name': 'volume-cd6b616d-d24f-4254-9ed2-055f5935b915', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fc002f-9c36-4d1c-a1c6-8da38686103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fc002f-9c36-4d1c-a1c6-8da38686103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af9f590-6182-4b3a-9d96-91c5ac16ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:14 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Volume cd6b616d-d24f-4254-9ed2-055f5935b915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6b616d-d24f-4254-9ed2-055f5935b915', 'volume_size': 1}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=aba13b9f-15d5-47eb-a320-aa572dd38d55,created_at=2026-09-09T11:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1919000839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=aba13b9f-15d5-47eb-a320-aa572dd38d55,host='devstack@QuobyteHD#QuobyteHD',id=cd6b616d-d24f-4254-9ed2-055f5935b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a6c30092f5743338b9d5d8dd3ed67fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:14Z,use_quota=True,user_id='9e77e9bd58bf48c6a4f30f87661f53d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23421b17-3270-4b97-a701-d7167c4aa845),volume_type_id=23421b17-3270-4b97-a701-d7167c4aa845)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Creating volume cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:15:14 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:15:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:14 devstack sudo[92680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 1073741824
Sep 09 13:15:14 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:15 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 1073741824" returned: 0 in 0.531s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:15 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:15 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:15 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af9f590-6182-4b3a-9d96-91c5ac16ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6b616d-d24f-4254-9ed2-055f5935b915', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758d502-6f36-4e98-a22e-30297696e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:15 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Volume volume-cd6b616d-d24f-4254-9ed2-055f5935b915 (cd6b616d-d24f-4254-9ed2-055f5935b915): created successfully
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758d502-6f36-4e98-a22e-30297696e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:15 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Flow 'volume_create_manager' (ffc59231-5930-47ac-bc46-9612b34944d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-81b5da0d-04f1-443b-83f2-551a3b849857 tempest-GroupsV314Test-702730711 None] Created volume successfully.
Sep 09 13:15:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:16 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Cloning volume cd6b616d-d24f-4254-9ed2-055f5935b915 to volume 1a149e23-6d09-4f52-a9d4-18f06b6bbb6f
Sep 09 13:15:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Creating offline snapshot 1326f536-6330-41f9-b75c-da53f930347c of volume cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:15:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7aa0a-7440-4152-9584-f6083709afeb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:17 devstack sudo[92706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:17 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:17 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.661s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:17 devstack sudo[92718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c 1G
Sep 09 13:15:17 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:17 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c 1G" returned: 0 in 0.541s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6b616d-d24f-4254-9ed2-055f5935b915 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:17 devstack sudo[92726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6b616d-d24f-4254-9ed2-055f5935b915 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:17 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:18 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6b616d-d24f-4254-9ed2-055f5935b915 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.508s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:18 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:15:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:18 devstack sudo[92734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:18 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:18 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.353s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:18 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info
Sep 09 13:15:18 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:19 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info" returned: 0 in 0.402s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:19 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:19 devstack sudo[92741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info
Sep 09 13:15:19 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:19 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.info" returned: 0 in 0.344s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Acquiring lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] snapshot: 1326f536-6330-41f9-b75c-da53f930347c, volume: 1a149e23-6d09-4f52-a9d4-18f06b6bbb6f,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c8c5e-bd5c-4327-a26e-dde7e95cfe96]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:19 devstack sudo[92750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:19 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:20 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.534s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6b616d-d24f-4254-9ed2-055f5935b915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:15:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99b4f1-17fe-4c5b-8892-389495e90df2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:20 devstack sudo[92767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:20 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:21 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.785s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:15:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:15:21 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:15:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:21 devstack sudo[92780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f
Sep 09 13:15:21 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:24 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:15:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (3583a529-f555-4d6f-a58e-311c4544f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d431d1b-2d30-44ff-91f0-e49eb1ef3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d431d1b-2d30-44ff-91f0-e49eb1ef3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-917047825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309dadbb-bf81-4964-9a15-de9be8506f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:25Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83269b92-de61-4fa3-9a54-6c2f13315408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83269b92-de61-4fa3-9a54-6c2f13315408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a523e67a-9939-48d8-902e-b90c8e5462d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a523e67a-9939-48d8-902e-b90c8e5462d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309dadbb-bf81-4964-9a15-de9be8506f4c', 'volume_name': 'volume-309dadbb-bf81-4964-9a15-de9be8506f4c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3912b0b5-6f65-4e56-ab90-37ad9cf35f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3912b0b5-6f65-4e56-ab90-37ad9cf35f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac0fc4-ac87-45d6-8baa-cf6c87224f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Volume 309dadbb-bf81-4964-9a15-de9be8506f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309dadbb-bf81-4964-9a15-de9be8506f4c', 'volume_size': 1}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:25 devstack sudo[92834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:25 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "cinder-af43312d-8f8d-4775-bc0b-240f5c34bc03-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "cinder-af43312d-8f8d-4775-bc0b-240f5c34bc03-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "cinder-quobyte-af43312d-8f8d-4775-bc0b-240f5c34bc03" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:26 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.712s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "cinder-quobyte-af43312d-8f8d-4775-bc0b-240f5c34bc03" acquired by "delete_volume" :: waited 0.083s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 8 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a677141-7ae8-4427-986c-6ccd4cd79480]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:26 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03
Sep 09 13:15:26 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:27 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03" returned: 0 in 0.880s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:27 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03
Sep 09 13:15:27 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:27 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af43312d-8f8d-4775-bc0b-240f5c34bc03" returned: 0 in 0.581s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "cinder-quobyte-af43312d-8f8d-4775-bc0b-240f5c34bc03" released by "delete_volume" :: held 1.557s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Created reservations ['e29b5174-1f3c-4632-b063-9aab90630fad', 'acdea6f8-104b-4c2d-a301-bc38ce7fa337', 'e4ecc262-ee26-459e-931a-57f13806efd8', 'c7157c81-0b7b-432a-b8b3-235e55361729'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:27 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" returned: 0 in 6.620s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:15:27 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Converted 1024.00 MB image at 154.65 MB/s
Sep 09 13:15:27 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:27 devstack sudo[92846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f
Sep 09 13:15:27 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:27 devstack sudo[92848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:27 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:27 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" returned: 0 in 0.256s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" released by "_copy_volume_from_snapshot" :: held 8.320s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Acquiring lock "cinder-quobyte-1326f536-6330-41f9-b75c-da53f930347c" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1326f536-6330-41f9-b75c-da53f930347c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Deleting offline snapshot 1326f536-6330-41f9-b75c-da53f930347c of volume cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:15:28 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] snapshot_file for this snap is: volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.255s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Deleted volume successfully.
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63e90de-c3a9-4ef6-98c5-509ae4106a9e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-829dea47-43bf-4da9-99dc-729b6922124a tempest-TaggedAttachmentsTest-895492161 None] Lock "cinder-af43312d-8f8d-4775-bc0b-240f5c34bc03-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:28 devstack sudo[92852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:28 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:28 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.374s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6b616d-d24f-4254-9ed2-055f5935b915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec7c9a-2c37-4eea-a365-1c228befa8e4]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:28 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:28 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:29 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.534s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:29 devstack sudo[92888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:29 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:29 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.369s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:29 devstack sudo[92893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c
Sep 09 13:15:29 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:29 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915.1326f536-6330-41f9-b75c-da53f930347c" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1326f536-6330-41f9-b75c-da53f930347c" released by "_delete_snapshot" :: held 1.663s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.145s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.434s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-917047825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309dadbb-bf81-4964-9a15-de9be8506f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:25Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Creating volume 309dadbb-bf81-4964-9a15-de9be8506f4c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:15:29 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:15:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:29 devstack sudo[92897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c 1073741824
Sep 09 13:15:29 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7cd9ad79-1b6b-4379-8211-a6636186a68b tempest-GroupsV314Test-702730711 None] Create group from source-group-aba13b9f-15d5-47eb-a320-aa572dd38d55 completed successfully.
Sep 09 13:15:30 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c 1073741824" returned: 0 in 0.465s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:30 devstack sudo[92903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c
Sep 09 13:15:30 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:30 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac0fc4-ac87-45d6-8baa-cf6c87224f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309dadbb-bf81-4964-9a15-de9be8506f4c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a1d940-2e25-48f3-857c-c635d3a7ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Volume volume-309dadbb-bf81-4964-9a15-de9be8506f4c (309dadbb-bf81-4964-9a15-de9be8506f4c): created successfully
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a1d940-2e25-48f3-857c-c635d3a7ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (3583a529-f555-4d6f-a58e-311c4544f439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4eaca579-d035-49ea-80e4-56b94c171020 tempest-AttachVolumeTestJSON-513932895 None] Created volume successfully.
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Acquiring lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8a2a1e-6878-4410-8c69-028afbb12331]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:31 devstack sudo[92912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f
Sep 09 13:15:31 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:31 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" returned: 0 in 0.476s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:32 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f
Sep 09 13:15:32 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:32 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" returned: 0 in 0.404s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-1a149e23-6d09-4f52-a9d4-18f06b6bbb6f" released by "delete_volume" :: held 0.937s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Created reservations ['26f0f6e2-80aa-48ea-b3bb-f760cf3a2053'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:32 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1415848849 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1415848849, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:15:32 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1415848849 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1415848849, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Created reservations ['3caf7887-1adb-4809-be34-afd329e0af56', 'edb5824e-89d0-4a97-9a7f-bf46f0a0d9ce', '6a68868b-55a6-466a-9984-ee0b5598e063', 'cd13b43d-52ac-4262-9378-8cebeb6dd39e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ab01b781-809c-4091-a621-ee8d1b01e5d2 req-9f62dd4a-6082-499b-842d-a71bb01e71de tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ab01b781-809c-4091-a621-ee8d1b01e5d2 req-9f62dd4a-6082-499b-842d-a71bb01e71de tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ab01b781-809c-4091-a621-ee8d1b01e5d2 req-9f62dd4a-6082-499b-842d-a71bb01e71de tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ab01b781-809c-4091-a621-ee8d1b01e5d2 req-9f62dd4a-6082-499b-842d-a71bb01e71de tempest-AttachVolumeTestJSON-513932895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-309dadbb-bf81-4964-9a15-de9be8506f4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '848f755e-1d0f-49ff-a601-f40847b69078', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:32 devstack sudo[92933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:32 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-ab01b781-809c-4091-a621-ee8d1b01e5d2 req-9f62dd4a-6082-499b-842d-a71bb01e71de tempest-AttachVolumeTestJSON-513932895 None] attachment_update completed successfully.
Sep 09 13:15:33 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.326s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:33 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b03cd092-74c4-4c19-ba9d-3ce0903f15a9 tempest-GroupsV314Test-702730711 None] Delete group completed successfully.
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Acquiring lock "cinder-quobyte-cd6b616d-d24f-4254-9ed2-055f5935b915" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-cd6b616d-d24f-4254-9ed2-055f5935b915" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e616b8f-4ac2-4a99-bd26-5fc4c34d225d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:34 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:34 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:34 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.505s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:34 devstack sudo[92945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915
Sep 09 13:15:34 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:35 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cd6b616d-d24f-4254-9ed2-055f5935b915" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Lock "cinder-quobyte-cd6b616d-d24f-4254-9ed2-055f5935b915" released by "delete_volume" :: held 0.951s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Created reservations ['47916ad0-bba2-45de-9024-2633e3e71491'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Created reservations ['c4527802-a779-4143-b7c3-f943327fdf11', 'f0238b04-fda7-4759-aa92-163502e8cced', 'aabeabfc-2940-4346-bc3a-bf96846c2533', 'ea500afb-c28e-4534-a01a-95d82a671d5a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (f0e44980-1cc5-452e-bbbb-9550c80aed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6278dee9-d818-4a9b-9fcc-a42a964a057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6278dee9-d818-4a9b-9fcc-a42a964a057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-98276967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cfda7c-d263-496a-ae74-e42826dd38db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:35Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b541281-65a6-4d1b-ad3d-094ef1e8d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b541281-65a6-4d1b-ad3d-094ef1e8d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15294f0-e11c-45c3-a733-60f7bb5f9345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15294f0-e11c-45c3-a733-60f7bb5f9345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cfda7c-d263-496a-ae74-e42826dd38db', 'volume_name': 'volume-99cfda7c-d263-496a-ae74-e42826dd38db', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa40276-71c1-49a1-8808-06163b134c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa40276-71c1-49a1-8808-06163b134c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2deb578-f9e3-41cf-be37-0ce6b28fe67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:35 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Volume 99cfda7c-d263-496a-ae74-e42826dd38db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cfda7c-d263-496a-ae74-e42826dd38db', 'volume_size': 1}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-98276967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cfda7c-d263-496a-ae74-e42826dd38db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4111828a1642b28d7715c0348972d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:35Z,use_quota=True,user_id='231561dc3d7c4405892e1cfe09965db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Creating volume 99cfda7c-d263-496a-ae74-e42826dd38db {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:15:35 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:35 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db 1073741824
Sep 09 13:15:35 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:35 devstack sudo[92953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:35 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:35 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:35 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0a1d4fb9-2541-4edd-a2c9-4172b2dc434a tempest-GroupsV314Test-702730711 None] Delete group completed successfully.
Sep 09 13:15:36 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db 1073741824" returned: 0 in 0.512s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:36 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db
Sep 09 13:15:36 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:36 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2deb578-f9e3-41cf-be37-0ce6b28fe67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cfda7c-d263-496a-ae74-e42826dd38db', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e844de-43a8-4b99-b54f-b07d76d6bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:36 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Volume volume-99cfda7c-d263-496a-ae74-e42826dd38db (99cfda7c-d263-496a-ae74-e42826dd38db): created successfully
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e844de-43a8-4b99-b54f-b07d76d6bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Flow 'volume_create_manager' (f0e44980-1cc5-452e-bbbb-9550c80aed8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d125cdc7-b5f9-4332-8888-6015013ff300 tempest-AttachVolumeTestJSON-513932895 None] Created volume successfully.
Sep 09 13:15:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-4fe5f732-0127-4daa-957f-fe5374a0a42a req-5500ec5e-aeec-47e5-8e5e-c81b692a2cbb tempest-ServerActionsTestOtherA-1035948921 None] Terminate volume connection completed successfully.
Sep 09 13:15:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-4fe5f732-0127-4daa-957f-fe5374a0a42a req-5500ec5e-aeec-47e5-8e5e-c81b692a2cbb tempest-ServerActionsTestOtherA-1035948921 None] Deleting attachment 06b0f05c-2a14-4b61-b37e-07b301277133. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:15:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-9067b72d-7c36-4d69-ba9e-a03c21cf2c67 req-03c8b0c9-1a1e-4769-b70a-2f62a1f04f78 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-9067b72d-7c36-4d69-ba9e-a03c21cf2c67 req-03c8b0c9-1a1e-4769-b70a-2f62a1f04f78 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-9067b72d-7c36-4d69-ba9e-a03c21cf2c67 req-03c8b0c9-1a1e-4769-b70a-2f62a1f04f78 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-9067b72d-7c36-4d69-ba9e-a03c21cf2c67 req-03c8b0c9-1a1e-4769-b70a-2f62a1f04f78 tempest-AttachVolumeTestJSON-513932895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-99cfda7c-d263-496a-ae74-e42826dd38db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '766c6d49-8de9-4c10-a274-1009c1736c2c', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:15:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-9067b72d-7c36-4d69-ba9e-a03c21cf2c67 req-03c8b0c9-1a1e-4769-b70a-2f62a1f04f78 tempest-AttachVolumeTestJSON-513932895 None] attachment_update completed successfully.
Sep 09 13:15:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-82364e41-efc0-4c32-932c-4fdc98870781 req-c411c59d-25b0-4294-802c-7818560f4a5b tempest-AttachVolumeTestJSON-513932895 None] Terminate volume connection completed successfully.
Sep 09 13:15:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-82364e41-efc0-4c32-932c-4fdc98870781 req-c411c59d-25b0-4294-802c-7818560f4a5b tempest-AttachVolumeTestJSON-513932895 None] Deleting attachment 848f755e-1d0f-49ff-a601-f40847b69078. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:15:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-0a922ddd-09ed-40a3-b638-32ee9f0a50c5 req-5dbdf89e-29a8-4cac-b889-1c1a2c4a02b8 tempest-AttachVolumeTestJSON-513932895 None] Terminate volume connection completed successfully.
Sep 09 13:15:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-0a922ddd-09ed-40a3-b638-32ee9f0a50c5 req-5dbdf89e-29a8-4cac-b889-1c1a2c4a02b8 tempest-AttachVolumeTestJSON-513932895 None] Deleting attachment 766c6d49-8de9-4c10-a274-1009c1736c2c. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Flow 'volume_create_manager' (6e2cd9c5-2c99-4e54-864f-4b4eb0fd08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d140233-20e9-4f6f-b3d2-a66c24d93cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d140233-20e9-4f6f-b3d2-a66c24d93cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-20474791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe86fc6-27ba-4522-a718-6f21b052f5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa96b3fe8f554034ae5306287843536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:45Z,use_quota=True,user_id='c0d976fd9f9741dd944df5819d744adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc98ab7-833f-410b-b163-490a8b69f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc98ab7-833f-410b-b163-490a8b69f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c12650-dc00-4c55-8250-3572fd5e8358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:44 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:15:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b663ecc2-4542-4e9f-9284-ace987d02457 tempest-GroupsV320Test-1953751429 None] Group tempest-GroupsV320Test-Group-236693067: creating
Sep 09 13:15:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b663ecc2-4542-4e9f-9284-ace987d02457 tempest-GroupsV320Test-1953751429 None] Group tempest-GroupsV320Test-Group-236693067: created successfully
Sep 09 13:15:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c12650-dc00-4c55-8250-3572fd5e8358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'volume_name': 'volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab546031d30>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c070e20-48ff-4463-898b-a4879bbc804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c070e20-48ff-4463-898b-a4879bbc804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9f86c1-4af5-4a0f-9b2e-acecfb25a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab546031d30>}
Sep 09 13:15:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Trying to clone 9fe86fc6-27ba-4522-a718-6f21b052f5fd from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:15:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b663ecc2-4542-4e9f-9284-ace987d02457 tempest-GroupsV320Test-1953751429 None] Create group completed successfully.
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:15:46 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0fa6e-d51a-4895-b718-71cb81620594]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:46 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD
Sep 09 13:15:46 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:46 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 is fetched for user c0d976fd9f9741dd944df5819d744adc. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[13555e67-5e00-4420-9079-ee654f3de7de]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:46 devstack sudo[93076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD
Sep 09 13:15:46 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:47 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-20474791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe86fc6-27ba-4522-a718-6f21b052f5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa96b3fe8f554034ae5306287843536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:15:45Z,use_quota=True,user_id='c0d976fd9f9741dd944df5819d744adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Creating volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:15:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:47 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1073741824
Sep 09 13:15:47 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Created reservations ['af951cb2-82ad-4d42-9f37-9aa05f48c732'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:47 devstack sudo[93086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:47 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:47 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1073741824" returned: 0 in 0.600s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:47 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.317s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1782a775-2b32-4f30-877e-e537b5912023 tempest-GroupsV320Test-1953751429 None] Delete group completed successfully.
Sep 09 13:15:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:47 devstack sudo[93091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd
Sep 09 13:15:47 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:48 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Attempting download of 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[56651d1d-00ea-42c5-a734-05df809848bd]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:48 devstack sudo[93095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z
Sep 09 13:15:48 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:48 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z" returned: 0 in 0.432s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:48 devstack sudo[93100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z
Sep 09 13:15:48 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:49 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z" returned: 1 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_px6bz29z' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66f3b8-d180-4933-95a9-44dc4f2ccbc6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:49 devstack sudo[93104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD
Sep 09 13:15:49 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-99cfda7c-d263-496a-ae74-e42826dd38db-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-99cfda7c-d263-496a-ae74-e42826dd38db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:49 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] 11a0fc37-23e8-4a61-8370-95b767ddcca5 was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-quobyte-99cfda7c-d263-496a-ae74-e42826dd38db" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:49 devstack sudo[93110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd
Sep 09 13:15:49 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-99cfda7c-d263-496a-ae74-e42826dd38db" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc298f-2edc-4913-8099-8002dc925235]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:49 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db
Sep 09 13:15:49 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:50 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db" returned: 0 in 0.654s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:50 devstack sudo[93122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db
Sep 09 13:15:50 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:50 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-99cfda7c-d263-496a-ae74-e42826dd38db" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-99cfda7c-d263-496a-ae74-e42826dd38db" released by "delete_volume" :: held 1.036s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Created reservations ['960f6bf1-e647-4fd5-ab71-142dae85a96b', '453bc7fc-b636-44a8-8abe-714588d852e3', '2c1d1b8a-3c27-441c-b3e6-2722909c9924', '3f4edb73-faba-4f36-bcad-ae69ae1ccfe7'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:50 devstack sudo[93125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:50 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:51 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.328s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Deleted volume successfully.
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-788f18b3-d937-420c-9a5e-4ccba18e1d41 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-99cfda7c-d263-496a-ae74-e42826dd38db-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-309dadbb-bf81-4964-9a15-de9be8506f4c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-309dadbb-bf81-4964-9a15-de9be8506f4c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-quobyte-309dadbb-bf81-4964-9a15-de9be8506f4c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-309dadbb-bf81-4964-9a15-de9be8506f4c" acquired by "delete_volume" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a936b-d01f-44c0-b448-e700e89e392b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:52 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c
Sep 09 13:15:52 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:52 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd" returned: 0 in 2.653s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_8cln_i86devstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:15:52 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Converted 112.00 MB image at 42.20 MB/s
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:52 devstack sudo[93131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1G
Sep 09 13:15:52 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:52 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c" returned: 0 in 0.480s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:52 devstack sudo[93136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c
Sep 09 13:15:52 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:52 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd 1G" returned: 0 in 0.535s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Downloaded image 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 for user c0d976fd9f9741dd944df5819d744adc is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Marking volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:15:52 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-309dadbb-bf81-4964-9a15-de9be8506f4c" returned: 0 in 0.320s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Copying metadata from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 to 9fe86fc6-27ba-4522-a718-6f21b052f5fd. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Creating volume glance metadata for volume 9fe86fc6-27ba-4522-a718-6f21b052f5fd backed by image 11a0fc37-23e8-4a61-8370-95b767ddcca5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-309dadbb-bf81-4964-9a15-de9be8506f4c" released by "delete_volume" :: held 0.865s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Created reservations ['d9cd1947-fe05-4bee-9797-993161a28adb', '7f518a8e-998f-4432-a63f-25a78f8d872d', '80b3a222-078c-4da7-828c-8cd2b69021d0', '4e8061eb-8467-4930-adba-7fb562228696'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9f86c1-4af5-4a0f-9b2e-acecfb25a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab546031d30>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b1fbc1-1b21-4891-a88a-66390801d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:15:52 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Volume volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd (9fe86fc6-27ba-4522-a718-6f21b052f5fd): created successfully
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b1fbc1-1b21-4891-a88a-66390801d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:15:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Flow 'volume_create_manager' (6e2cd9c5-2c99-4e54-864f-4b4eb0fd08e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:15:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2a469b7f-647a-4551-8807-8585102659b2 tempest-ServerActionsTestOtherA-1035948921 None] Created volume successfully.
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:53 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:53 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-4ed84bea-4168-4bdb-9320-e576ba5eb98d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-4ed84bea-4168-4bdb-9320-e576ba5eb98d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "cinder-quobyte-4ed84bea-4168-4bdb-9320-e576ba5eb98d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-4ed84bea-4168-4bdb-9320-e576ba5eb98d" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[43feff43-1c34-48c7-9552-01f83b51a00b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:53 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.404s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Deleted volume successfully.
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c62d9eef-c3f9-4d11-a1f7-72e570529fe0 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-309dadbb-bf81-4964-9a15-de9be8506f4c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:53 devstack sudo[93146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d
Sep 09 13:15:53 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:53 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:53 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d
Sep 09 13:15:53 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:54 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4ed84bea-4168-4bdb-9320-e576ba5eb98d" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-quobyte-4ed84bea-4168-4bdb-9320-e576ba5eb98d" released by "delete_volume" :: held 0.921s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Created reservations ['40dfc33d-10ce-40eb-ab4c-a754a16e4ca4', 'a39c7aa2-0405-4b68-a0dc-85a1bb28ca2c', '4d255377-7082-4b4c-89f0-57ac8121d358', '182f27d3-2d59-4b3e-8f84-4e72a930b614'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:15:54 devstack sudo[93154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:15:54 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:15:54 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.518s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:15:54 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:15:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Deleted volume successfully.
Sep 09 13:15:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67710eb9-888e-4ba4-bc2a-c31695568501 tempest-AttachVolumeTestJSON-513932895 None] Lock "cinder-4ed84bea-4168-4bdb-9320-e576ba5eb98d-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:15:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21a10cb0-4f71-4353-8c4e-57eb237570ce req-497c23b3-a8a0-4d04-be2b-572c195ebdd8 tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:15:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21a10cb0-4f71-4353-8c4e-57eb237570ce req-497c23b3-a8a0-4d04-be2b-572c195ebdd8 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:15:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21a10cb0-4f71-4353-8c4e-57eb237570ce req-497c23b3-a8a0-4d04-be2b-572c195ebdd8 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:15:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-21a10cb0-4f71-4353-8c4e-57eb237570ce req-497c23b3-a8a0-4d04-be2b-572c195ebdd8 tempest-ServerActionsTestOtherA-1035948921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b2a5e54-b07e-4bb0-940c-fc309ae3675e', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:15:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-21a10cb0-4f71-4353-8c4e-57eb237570ce req-497c23b3-a8a0-4d04-be2b-572c195ebdd8 tempest-ServerActionsTestOtherA-1035948921 None] attachment_update completed successfully.
Sep 09 13:16:06 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=90,cinder:UPDATE=81,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:16:06 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=90,cinder:UPDATE=79,cinder:INSERT=27,cinder:DELETE=4 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Flow 'volume_create_manager' (9f03e6e9-bc48-4bb7-9a27-d3aac8f10cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91353acb-c350-4b9f-9ecc-7ca2cdb65b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91353acb-c350-4b9f-9ecc-7ca2cdb65b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2119870096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89aa6da4-c7b6-4f77-92fc-5511a05a3adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce494c4514042a39f4999e6462f7dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:11Z,use_quota=True,user_id='ea9cf9eb969246c48f28673faf0ad935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e4b2c7-f949-4594-b6ef-5fab3392fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e4b2c7-f949-4594-b6ef-5fab3392fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11612583-725d-45e7-ac91-b802da9bac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11612583-725d-45e7-ac91-b802da9bac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89aa6da4-c7b6-4f77-92fc-5511a05a3adb', 'volume_name': 'volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f67b8-2a4d-4ee2-9479-26465ae44977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f67b8-2a4d-4ee2-9479-26465ae44977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba3d834-54b1-4653-9730-cbeadb24eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:11 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Volume 89aa6da4-c7b6-4f77-92fc-5511a05a3adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb', 'volume_size': 1}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2119870096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89aa6da4-c7b6-4f77-92fc-5511a05a3adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce494c4514042a39f4999e6462f7dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:11Z,use_quota=True,user_id='ea9cf9eb969246c48f28673faf0ad935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Creating volume 89aa6da4-c7b6-4f77-92fc-5511a05a3adb {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:16:11 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:16:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:11 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb 1073741824
Sep 09 13:16:11 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:12 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb 1073741824" returned: 0 in 0.960s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:12 devstack sudo[93667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb
Sep 09 13:16:12 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:12 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" returned: 0 in 0.455s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba3d834-54b1-4653-9730-cbeadb24eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab477e18-e6d9-4e93-a920-7f05baa6790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:13 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Volume volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb (89aa6da4-c7b6-4f77-92fc-5511a05a3adb): created successfully
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab477e18-e6d9-4e93-a920-7f05baa6790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Flow 'volume_create_manager' (9f03e6e9-bc48-4bb7-9a27-d3aac8f10cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2aba765-4230-4e57-b5ee-342559783a3e tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Created volume successfully.
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Acquiring lock "cinder-89aa6da4-c7b6-4f77-92fc-5511a05a3adb-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "cinder-89aa6da4-c7b6-4f77-92fc-5511a05a3adb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Acquiring lock "cinder-quobyte-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "cinder-quobyte-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" acquired by "delete_volume" :: waited 0.051s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f1f12-79b3-4934-bb11-f5dabea11679]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:16:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:15 devstack sudo[93673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb
Sep 09 13:16:15 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:16 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" returned: 0 in 0.757s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:16 devstack sudo[93679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb
Sep 09 13:16:16 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:17 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" returned: 0 in 0.574s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "cinder-quobyte-89aa6da4-c7b6-4f77-92fc-5511a05a3adb" released by "delete_volume" :: held 1.442s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Created reservations ['09e086a6-526d-448f-87ce-3525977c0ef7', '14c5347a-40ae-42aa-bdcd-73d6768e8541', '6929e5da-ca3e-4c47-bd64-4c3d7c7f3053', 'bcdbfd60-ccce-425f-bd93-92ed37ead60d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:17 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:16:17 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:18 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.874s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:18 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:16:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Deleted volume successfully.
Sep 09 13:16:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-be8af851-2b66-4c0d-9761-98631110eaa4 tempest-VolumeQuotasNegativeTestJSON-1154909294 None] Lock "cinder-89aa6da4-c7b6-4f77-92fc-5511a05a3adb-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:25 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:16:25 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:25 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.455s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:16:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:16:27 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:16:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-8293b9eb-37cc-4569-a072-a60d35480ed7 tempest-ServerActionsTestOtherA-1035948921 None] Terminate volume connection completed successfully.
Sep 09 13:16:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-8293b9eb-37cc-4569-a072-a60d35480ed7 tempest-ServerActionsTestOtherA-1035948921 None] Deleting attachment 8b2a5e54-b07e-4bb0-940c-fc309ae3675e. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:16:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-d364ee9a-9a75-44e0-bab8-0c64b2d7fff6 tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-d364ee9a-9a75-44e0-bab8-0c64b2d7fff6 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-d364ee9a-9a75-44e0-bab8-0c64b2d7fff6 tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-d364ee9a-9a75-44e0-bab8-0c64b2d7fff6 tempest-ServerActionsTestOtherA-1035948921 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8d3bcfd-e083-44ca-9a13-23479f68de81', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:16:31 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-eb05eb82-6ca1-4230-ab17-31f629f166a8 req-d364ee9a-9a75-44e0-bab8-0c64b2d7fff6 tempest-ServerActionsTestOtherA-1035948921 None] attachment_update completed successfully.
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Flow 'volume_create_manager' (a1115e32-8d01-4078-b85b-0364c7427ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d915ac-8554-4205-a397-d711d1413146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d915ac-8554-4205-a397-d711d1413146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1125445381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ae4b76d8df4b26be6b86243144185e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:33Z,use_quota=True,user_id='3a0d439f44104c1e8c3945be3c61d43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5e547b-07f9-44ee-a2c9-2874622a4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5e547b-07f9-44ee-a2c9-2874622a4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573cff6f-8395-4b42-b2ed-6063bf3d3927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573cff6f-8395-4b42-b2ed-6063bf3d3927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca', 'volume_name': 'volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87873947-f255-4f8a-b3e7-4e4e3482a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87873947-f255-4f8a-b3e7-4e4e3482a150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6992f5-b22a-4b70-b591-e68a8cd4cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Volume 3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca', 'volume_size': 1}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1125445381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ae4b76d8df4b26be6b86243144185e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:33Z,use_quota=True,user_id='3a0d439f44104c1e8c3945be3c61d43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Creating volume 3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:16:32 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:16:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:33 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca 1073741824
Sep 09 13:16:33 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Flow 'volume_create_manager' (8484082c-5cf2-4d93-946d-64a3d4088931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9f894c-209d-45c7-ad79-8bf556103555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9f894c-209d-45c7-ad79-8bf556103555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1337738893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a2f2bbf34c1698d38833bf4bb73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:33Z,use_quota=True,user_id='24dcad0268804e5cafaa4dcd10aa7dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6c63b0-bf6b-4f81-b088-c9ad54e9a616),volume_type_id=8b6c63b0-bf6b-4f81-b088-c9ad54e9a616)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1dd50c-b582-4e03-8196-caa66c227b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1dd50c-b582-4e03-8196-caa66c227b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7ebd32-8c1e-41bb-9d20-4414cd3720d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7ebd32-8c1e-41bb-9d20-4414cd3720d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ce0680-9efc-4f8b-b747-6a1e6d7bc32c', 'volume_name': 'volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984366f-ce0a-4bb5-964e-31117aa108ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984366f-ce0a-4bb5-964e-31117aa108ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529ed1f0-f1e3-43f8-a0c9-899f75f5a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Volume d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c', 'volume_size': 1}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:33 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca 1073741824" returned: 0 in 0.646s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:33 devstack sudo[94317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca
Sep 09 13:16:33 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:33 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1337738893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a2f2bbf34c1698d38833bf4bb73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:33Z,use_quota=True,user_id='24dcad0268804e5cafaa4dcd10aa7dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6c63b0-bf6b-4f81-b088-c9ad54e9a616),volume_type_id=8b6c63b0-bf6b-4f81-b088-c9ad54e9a616)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Creating volume d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:16:33 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:16:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6992f5-b22a-4b70-b591-e68a8cd4cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:34 devstack sudo[94320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c 1073741824
Sep 09 13:16:34 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fbfd89-b069-4166-862a-cf3372992c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Volume volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca (3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca): created successfully
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fbfd89-b069-4166-862a-cf3372992c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Flow 'volume_create_manager' (a1115e32-8d01-4078-b85b-0364c7427ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-eeb46f37-6668-446c-b288-a2e395399d9c tempest-VolumesServicesTestJSON-1442241271 None] Created volume successfully.
Sep 09 13:16:34 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c 1073741824" returned: 0 in 0.640s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:34 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c
Sep 09 13:16:34 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:34 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529ed1f0-f1e3-43f8-a0c9-899f75f5a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958291f0-0f79-413d-b908-a0c3c9e0c24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:35 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Volume volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c (d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c): created successfully
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958291f0-0f79-413d-b908-a0c3c9e0c24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Flow 'volume_create_manager' (8484082c-5cf2-4d93-946d-64a3d4088931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1dbe5667-e9b5-4465-8e06-04fc1ccb82c5 tempest-VolumeTypesAccessTest-181787272 None] Created volume successfully.
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Acquiring lock "cinder-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "cinder-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Acquiring lock "cinder-quobyte-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "cinder-quobyte-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f7e834-f42f-44f4-b88a-3c15fb61b8a3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:35 devstack sudo[94331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca
Sep 09 13:16:35 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Acquiring lock "cinder-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "cinder-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Acquiring lock "cinder-quobyte-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "cinder-quobyte-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6f07cb-5be7-48e4-91ef-4458531e8cdd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:35 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" returned: 0 in 0.594s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:35 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca
Sep 09 13:16:35 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:35 devstack sudo[94337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c
Sep 09 13:16:35 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:36 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" returned: 0 in 0.531s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:36 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" returned: 0 in 0.515s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:36 devstack sudo[94346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c
Sep 09 13:16:36 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "cinder-quobyte-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca" released by "delete_volume" :: held 1.182s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Created reservations ['cc406d67-ea28-46ed-9d50-cde1d12eee52', '376527a7-6975-4e87-9c24-6d22d0e3e9a5', '73dc9f4b-70c6-49c4-b499-aab3502b873c', 'fc7305df-9b00-4d36-9e54-148d134edc4e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:36 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:16:36 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:36 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" returned: 0 in 0.487s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "cinder-quobyte-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c" released by "delete_volume" :: held 1.092s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:36 devstack cinder-volume[87606]: WARNING cinder.quota [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1758589666 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1758589666, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:16:36 devstack cinder-volume[87606]: WARNING cinder.quota [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1758589666 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1758589666, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Created reservations ['5ee62ed1-86e1-4d4d-8664-5f37c357f280', '32c754e7-1b22-4a80-9f68-551222f85696', '1776c202-1cf7-44c1-bae3-d72b32a11d2b', '310be6c7-03c5-4c5a-bc4d-a430ab630cae'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:36 devstack sudo[94352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:16:36 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:36 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:16:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Deleted volume successfully.
Sep 09 13:16:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-352097da-1f46-40d0-bf99-4012204ce8be tempest-VolumesServicesTestJSON-1442241271 None] Lock "cinder-3ec897ea-a9a2-48e9-a061-aa5cd9afe7ca-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:37 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.315s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:37 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:16:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Deleted volume successfully.
Sep 09 13:16:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9022d603-9a2a-4ef2-a55c-f4d4fe0987b8 tempest-VolumeTypesAccessTest-181787272 None] Lock "cinder-d8ce0680-9efc-4f8b-b747-6a1e6d7bc32c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Flow 'volume_create_manager' (5cf785ee-df87-431c-a047-604186a305a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918efb3d-e8cb-4dc7-a4b6-a3eef8de57f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918efb3d-e8cb-4dc7-a4b6-a3eef8de57f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-264542995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce089b2-f5cc-4bf7-88a6-454fda37eae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c172f0fe80429482dd5bc5f27defc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:46Z,use_quota=True,user_id='24041f2430974ce59ed83445ade4d43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2536638f-aa45-452d-b8fc-87d0b449e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2536638f-aa45-452d-b8fc-87d0b449e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8787790-e0ad-4096-b632-df0ba2b6ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8787790-e0ad-4096-b632-df0ba2b6ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce089b2-f5cc-4bf7-88a6-454fda37eae6', 'volume_name': 'volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf6c1d6-93f8-4f3b-9d82-eaacb6dfd533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf6c1d6-93f8-4f3b-9d82-eaacb6dfd533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d12f84c-8943-4a22-a691-79d071ac9ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Volume 3ce089b2-f5cc-4bf7-88a6-454fda37eae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6', 'volume_size': 1}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-264542995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce089b2-f5cc-4bf7-88a6-454fda37eae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c172f0fe80429482dd5bc5f27defc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:46Z,use_quota=True,user_id='24041f2430974ce59ed83445ade4d43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Creating volume 3ce089b2-f5cc-4bf7-88a6-454fda37eae6 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:16:45 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:16:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:45 devstack sudo[94361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 1073741824
Sep 09 13:16:45 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:46 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 1073741824" returned: 0 in 0.574s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:46 devstack sudo[94367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6
Sep 09 13:16:46 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:46 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d12f84c-8943-4a22-a691-79d071ac9ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556eddc7-98db-42c0-ac9e-f8e87810b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Volume volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 (3ce089b2-f5cc-4bf7-88a6-454fda37eae6): created successfully
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556eddc7-98db-42c0-ac9e-f8e87810b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Flow 'volume_create_manager' (5cf785ee-df87-431c-a047-604186a305a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5950a0b9-7dda-47cc-a858-dfe297bc7a04 tempest-AttachVolumeShelveTestJSON-895971606 None] Created volume successfully.
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Flow 'volume_create_manager' (e5b99a8c-66ff-4ecf-82ac-424a0053d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c48fed3-2d2f-4b23-a42d-b61b08b41d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c48fed3-2d2f-4b23-a42d-b61b08b41d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790702742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c05186-4662-4a2c-943d-c08bfe2809b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709f87d050d54524ae0126d0c027b281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:54Z,use_quota=True,user_id='20a3643bab92474382fd83af8e236d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e352be8c-dd3f-4c90-a0b7-21e812df4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e352be8c-dd3f-4c90-a0b7-21e812df4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdda882b-6f73-4f1e-adf9-9bc878a8b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdda882b-6f73-4f1e-adf9-9bc878a8b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c05186-4662-4a2c-943d-c08bfe2809b2', 'volume_name': 'volume-05c05186-4662-4a2c-943d-c08bfe2809b2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbafb07-e014-4069-b458-01c015b773ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbafb07-e014-4069-b458-01c015b773ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5055cd7e-9c9c-4008-be71-9744cd69818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:53 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Volume 05c05186-4662-4a2c-943d-c08bfe2809b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c05186-4662-4a2c-943d-c08bfe2809b2', 'volume_size': 1}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790702742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c05186-4662-4a2c-943d-c08bfe2809b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709f87d050d54524ae0126d0c027b281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:16:54Z,use_quota=True,user_id='20a3643bab92474382fd83af8e236d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Creating volume 05c05186-4662-4a2c-943d-c08bfe2809b2 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:16:54 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:54 devstack sudo[94417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 1073741824
Sep 09 13:16:54 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:54 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 1073741824" returned: 0 in 0.546s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:54 devstack sudo[94423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2
Sep 09 13:16:54 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:54 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2" returned: 0 in 0.317s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5055cd7e-9c9c-4008-be71-9744cd69818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c05186-4662-4a2c-943d-c08bfe2809b2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2553a5eb-8b4b-471c-8162-4f0016012c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:16:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Volume volume-05c05186-4662-4a2c-943d-c08bfe2809b2 (05c05186-4662-4a2c-943d-c08bfe2809b2): created successfully
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2553a5eb-8b4b-471c-8162-4f0016012c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:16:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Flow 'volume_create_manager' (e5b99a8c-66ff-4ecf-82ac-424a0053d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:16:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4b84c527-dd6d-41d1-9f74-43915d11cdde tempest-AbsoluteLimitsTests-668512683 None] Created volume successfully.
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Acquiring lock "cinder-05c05186-4662-4a2c-943d-c08bfe2809b2-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "cinder-05c05186-4662-4a2c-943d-c08bfe2809b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Acquiring lock "cinder-quobyte-05c05186-4662-4a2c-943d-c08bfe2809b2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "cinder-quobyte-05c05186-4662-4a2c-943d-c08bfe2809b2" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b46b7fd-24ca-423e-9e17-587728aaa6f7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:16:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:56 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2
Sep 09 13:16:56 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:57 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2" returned: 0 in 0.400s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:57 devstack sudo[94450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2
Sep 09 13:16:57 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:57 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05c05186-4662-4a2c-943d-c08bfe2809b2" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "cinder-quobyte-05c05186-4662-4a2c-943d-c08bfe2809b2" released by "delete_volume" :: held 0.717s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Created reservations ['55e75d05-028a-4976-96c8-275b7b781d6d', '59b7164c-6b43-43b0-a931-dbd7ad37191a', '2af26fee-a643-4d23-8960-941309538e20', 'b93fedd6-9664-405b-aae3-55885e90b368'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:16:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:16:57 devstack sudo[94453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:16:57 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:16:58 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root
Sep 09 13:16:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.391s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:16:58 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:16:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Deleted volume successfully.
Sep 09 13:16:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7e75f230-7465-4d2f-9f64-831750ce0342 tempest-AbsoluteLimitsTests-668512683 None] Lock "cinder-05c05186-4662-4a2c-943d-c08bfe2809b2-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:16:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-3ce2820e-6b8d-46ce-9869-27ab9907f575 req-5d5e7637-7e97-448f-9780-8ea22bde98ac tempest-AttachVolumeShelveTestJSON-895971606 None] No connector for attachment 74b9b021-9186-4dba-9605-e76ec2cec5c7; skipping storage backend terminate_connection call. {{(pid=87606) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 09 13:16:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-3ce2820e-6b8d-46ce-9869-27ab9907f575 req-5d5e7637-7e97-448f-9780-8ea22bde98ac tempest-AttachVolumeShelveTestJSON-895971606 None] Deleting attachment 74b9b021-9186-4dba-9605-e76ec2cec5c7. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:17:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-ff9173cb-c49f-40d7-890f-001e52865346 tempest-ServerActionsTestOtherA-1035948921 None] Terminate volume connection completed successfully.
Sep 09 13:17:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-ff9173cb-c49f-40d7-890f-001e52865346 tempest-ServerActionsTestOtherA-1035948921 None] Deleting attachment a8d3bcfd-e083-44ca-9a13-23479f68de81. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:17:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "cinder-9fe86fc6-27ba-4522-a718-6f21b052f5fd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-9fe86fc6-27ba-4522-a718-6f21b052f5fd-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "cinder-quobyte-9fe86fc6-27ba-4522-a718-6f21b052f5fd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-quobyte-9fe86fc6-27ba-4522-a718-6f21b052f5fd" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc965c54-6f9d-43a2-b05b-2a6ff61839c8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:06 devstack sudo[94511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd
Sep 09 13:17:06 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:06 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd" returned: 0 in 0.426s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:06 devstack sudo[94516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd
Sep 09 13:17:06 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:06 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9fe86fc6-27ba-4522-a718-6f21b052f5fd" returned: 0 in 0.309s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-quobyte-9fe86fc6-27ba-4522-a718-6f21b052f5fd" released by "delete_volume" :: held 0.807s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG cinder.quota [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Created reservations ['b0e6533d-c212-4a63-be31-2bd058ec0b25', '45809063-cf67-488b-bdf1-a681d1d31dcd', '78755b2f-e84e-44f1-aad1-66e7b50e866e', 'b2441ecc-fc16-4124-b178-3eb0b332910d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:06 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=47,cinder:UPDATE=52,cinder:INSERT=9,cinder:DELETE=6 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:07 devstack sudo[94519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:07 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "cinder-dd7f172c-6133-49dd-a94e-8791d05ecb60-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-dd7f172c-6133-49dd-a94e-8791d05ecb60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "cinder-quobyte-dd7f172c-6133-49dd-a94e-8791d05ecb60" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:07 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.479s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.manager [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Deleted volume successfully.
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-quobyte-dd7f172c-6133-49dd-a94e-8791d05ecb60" acquired by "delete_volume" :: waited 0.044s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-05e87a97-d91a-481a-9d32-01b6428a64c1 req-270a9a34-0373-4a1d-8aec-66531bcc9c3e tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-9fe86fc6-27ba-4522-a718-6f21b052f5fd-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1866a0c-afd2-48be-9a57-10392766ef65]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:07 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60
Sep 09 13:17:07 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:08 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:08 devstack sudo[94528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60
Sep 09 13:17:08 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:08 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-dd7f172c-6133-49dd-a94e-8791d05ecb60" returned: 0 in 0.345s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-quobyte-dd7f172c-6133-49dd-a94e-8791d05ecb60" released by "delete_volume" :: held 0.938s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Created reservations ['88b790a1-c4ab-49d5-ab5f-0ae5bec34c1b', '70cb1301-924d-46fb-aa66-b73160f2b1b7', '68c9d7e9-005f-4e06-81aa-a496decd5ec8', '3f28bc04-fc3e-4815-9c26-a6ee30ae516d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:08 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:08 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:09 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:09 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Deleted volume successfully.
Sep 09 13:17:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6d856fb-e274-4ed7-a815-7c8a875f0cba tempest-ServerActionsTestOtherA-1035948921 None] Lock "cinder-dd7f172c-6133-49dd-a94e-8791d05ecb60-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Flow 'volume_create_manager' (22643dce-4cff-4087-b8e5-15a3c54fda36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4a696a-fc61-45e8-88fe-8bf597e268fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4a696a-fc61-45e8-88fe-8bf597e268fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1917375015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113de6d3-f29f-4de8-8441-b3199916f608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14906d3ba48f465dab1e2ea5814aaa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:12Z,use_quota=True,user_id='03b6b36760a74d79b73efc53cb374d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0e09bd-3dd2-4930-99f4-774118b00b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0e09bd-3dd2-4930-99f4-774118b00b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d465019e-df7d-40c5-851a-53724eaa8f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d465019e-df7d-40c5-851a-53724eaa8f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113de6d3-f29f-4de8-8441-b3199916f608', 'volume_name': 'volume-113de6d3-f29f-4de8-8441-b3199916f608', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b01e77-d444-43b5-be91-2ae95b0154ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b01e77-d444-43b5-be91-2ae95b0154ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722002c-6ee2-43a7-a813-ecb9c031ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:12 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Volume 113de6d3-f29f-4de8-8441-b3199916f608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113de6d3-f29f-4de8-8441-b3199916f608', 'volume_size': 1}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1917375015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113de6d3-f29f-4de8-8441-b3199916f608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14906d3ba48f465dab1e2ea5814aaa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:12Z,use_quota=True,user_id='03b6b36760a74d79b73efc53cb374d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Creating volume 113de6d3-f29f-4de8-8441-b3199916f608 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:12 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:12 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 1073741824
Sep 09 13:17:12 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:13 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 1073741824" returned: 0 in 0.849s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:13 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608
Sep 09 13:17:13 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:13 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722002c-6ee2-43a7-a813-ecb9c031ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113de6d3-f29f-4de8-8441-b3199916f608', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f7d49d-5a57-4b97-b921-3b88bce105e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:13 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Volume volume-113de6d3-f29f-4de8-8441-b3199916f608 (113de6d3-f29f-4de8-8441-b3199916f608): created successfully
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f7d49d-5a57-4b97-b921-3b88bce105e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Flow 'volume_create_manager' (22643dce-4cff-4087-b8e5-15a3c54fda36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-42322ab4-c05c-442a-b545-f309a4c7640b tempest-VolumesTransfersV357Test-1954757757 None] Created volume successfully.
Sep 09 13:17:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d4636e28-d901-4cb0-9e97-bd38eb954756 tempest-VolumesTransfersV357Test-64757756 None] Transfer volume completed successfully.
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "cinder-113de6d3-f29f-4de8-8441-b3199916f608-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-113de6d3-f29f-4de8-8441-b3199916f608-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "cinder-quobyte-113de6d3-f29f-4de8-8441-b3199916f608" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-quobyte-113de6d3-f29f-4de8-8441-b3199916f608" acquired by "delete_volume" :: waited 0.051s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e387d64b-481e-4b0b-aa43-275261b17323]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:16 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608
Sep 09 13:17:16 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:17 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608" returned: 0 in 0.510s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:17 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608
Sep 09 13:17:17 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:17 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-113de6d3-f29f-4de8-8441-b3199916f608" returned: 0 in 0.513s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-quobyte-113de6d3-f29f-4de8-8441-b3199916f608" released by "delete_volume" :: held 1.132s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Created reservations ['bb0456a7-2b81-464f-a3ac-8967423606fd', '78c82664-f7f2-4116-a01a-c6176be7a991', 'a9c0022c-2951-46e3-bda5-4261c14fa119', 'b64b21af-f692-4954-9d91-19ae4e0f4fc4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:18 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:18 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:18 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.401s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:18 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Deleted volume successfully.
Sep 09 13:17:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67349810-de32-4283-ad52-369feac86366 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-113de6d3-f29f-4de8-8441-b3199916f608-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Flow 'volume_create_manager' (33bde39f-7523-4eaf-bd2a-fa0267d55065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798aa8ca-e2d5-4213-a0a3-c4848616ec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798aa8ca-e2d5-4213-a0a3-c4848616ec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-839130622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f45496-5eae-4dad-8c92-41b75f9325f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14906d3ba48f465dab1e2ea5814aaa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:20Z,use_quota=True,user_id='03b6b36760a74d79b73efc53cb374d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f2117-5543-4340-bd63-7ae144e59673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0f2117-5543-4340-bd63-7ae144e59673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb737ed2-9fd2-4a4f-8af9-9e89c822009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb737ed2-9fd2-4a4f-8af9-9e89c822009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f45496-5eae-4dad-8c92-41b75f9325f9', 'volume_name': 'volume-96f45496-5eae-4dad-8c92-41b75f9325f9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c9068-6794-4f39-ba5c-f7729ae0b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c9068-6794-4f39-ba5c-f7729ae0b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd8561-813f-4b2b-be79-a2683b47b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Volume 96f45496-5eae-4dad-8c92-41b75f9325f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f45496-5eae-4dad-8c92-41b75f9325f9', 'volume_size': 1}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-839130622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f45496-5eae-4dad-8c92-41b75f9325f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14906d3ba48f465dab1e2ea5814aaa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:20Z,use_quota=True,user_id='03b6b36760a74d79b73efc53cb374d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Creating volume 96f45496-5eae-4dad-8c92-41b75f9325f9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:20 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:20 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 1073741824
Sep 09 13:17:20 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:21 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 1073741824" returned: 0 in 1.048s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:21 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9
Sep 09 13:17:21 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:21 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd8561-813f-4b2b-be79-a2683b47b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f45496-5eae-4dad-8c92-41b75f9325f9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fc70b5-1ac6-41f1-8ff0-4329a72efcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Volume volume-96f45496-5eae-4dad-8c92-41b75f9325f9 (96f45496-5eae-4dad-8c92-41b75f9325f9): created successfully
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fc70b5-1ac6-41f1-8ff0-4329a72efcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Flow 'volume_create_manager' (33bde39f-7523-4eaf-bd2a-fa0267d55065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-221ed1db-25d8-4ff8-9039-4b5fe2853ea5 tempest-VolumesTransfersV357Test-1954757757 None] Created volume successfully.
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "cinder-96f45496-5eae-4dad-8c92-41b75f9325f9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-96f45496-5eae-4dad-8c92-41b75f9325f9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "cinder-quobyte-96f45496-5eae-4dad-8c92-41b75f9325f9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-quobyte-96f45496-5eae-4dad-8c92-41b75f9325f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62dc72c-ecb2-41ba-96cf-a2ec642371b9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:22 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9
Sep 09 13:17:22 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:23 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9" returned: 0 in 0.542s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:23 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9
Sep 09 13:17:23 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:23 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96f45496-5eae-4dad-8c92-41b75f9325f9" returned: 0 in 0.392s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-quobyte-96f45496-5eae-4dad-8c92-41b75f9325f9" released by "delete_volume" :: held 1.031s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:23 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Created reservations ['7196d8fe-de5d-4910-84f4-0e25b4e56740', '327cc3a7-205a-4521-bf49-ec5fcf86f6bb', 'e7b6d52a-a97e-4f92-acb4-558053de8462', 'a496befd-d621-447c-b741-e4f4c1597c26'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:24 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:24 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:24 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.368s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Deleted volume successfully.
Sep 09 13:17:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3baf1d0e-63f1-4778-990f-99931c6244d2 tempest-VolumesTransfersV357Test-579734909 None] Lock "cinder-96f45496-5eae-4dad-8c92-41b75f9325f9-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:25 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:25 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:25 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.390s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:17:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=54,cinder:UPDATE=88,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Flow 'volume_create_manager' (b285b2a4-7584-4ee3-b973-410a2785bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67829698-e42a-427b-adf7-3f446b5a7cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67829698-e42a-427b-adf7-3f446b5a7cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-404762140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f75290-cb47-43da-b223-8ca7524d99e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eea254b9f9f4e79af74fb04666c2e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:35Z,use_quota=True,user_id='66c683fa9bd14eba8f5617a5c1c8d1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f2baff-e270-4e9a-99a8-1b43a9731a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f2baff-e270-4e9a-99a8-1b43a9731a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd7b1c3-c0c4-4539-b1fd-b29d71559545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd7b1c3-c0c4-4539-b1fd-b29d71559545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f75290-cb47-43da-b223-8ca7524d99e9', 'volume_name': 'volume-38f75290-cb47-43da-b223-8ca7524d99e9', 'volume_size': 2}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece84e84-5e35-4fa9-a071-6e1d023ae60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece84e84-5e35-4fa9-a071-6e1d023ae60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe8669d-2acb-4508-ba08-59a255450e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Volume 38f75290-cb47-43da-b223-8ca7524d99e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f75290-cb47-43da-b223-8ca7524d99e9', 'volume_size': 2}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-404762140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f75290-cb47-43da-b223-8ca7524d99e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eea254b9f9f4e79af74fb04666c2e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:35Z,use_quota=True,user_id='66c683fa9bd14eba8f5617a5c1c8d1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Creating volume 38f75290-cb47-43da-b223-8ca7524d99e9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:34 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 2147483648 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:35 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 2147483648
Sep 09 13:17:35 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:35 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 2147483648" returned: 0 in 0.753s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:35 devstack sudo[94845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9
Sep 09 13:17:35 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:36 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9" returned: 0 in 0.371s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe8669d-2acb-4508-ba08-59a255450e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f75290-cb47-43da-b223-8ca7524d99e9', 'volume_size': 2}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6983dd-9eca-4a7c-822c-d10a42ea9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:36 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Volume volume-38f75290-cb47-43da-b223-8ca7524d99e9 (38f75290-cb47-43da-b223-8ca7524d99e9): created successfully
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6983dd-9eca-4a7c-822c-d10a42ea9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Flow 'volume_create_manager' (b285b2a4-7584-4ee3-b973-410a2785bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-60053be7-afb1-41a3-979e-1cab6527d211 tempest-VolumesCloneNegativeTest-603158528 None] Created volume successfully.
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Acquiring lock "cinder-38f75290-cb47-43da-b223-8ca7524d99e9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "cinder-38f75290-cb47-43da-b223-8ca7524d99e9-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Acquiring lock "cinder-quobyte-38f75290-cb47-43da-b223-8ca7524d99e9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "cinder-quobyte-38f75290-cb47-43da-b223-8ca7524d99e9" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3d9ee-25a0-483b-8563-877685038b92]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:37 devstack sudo[94878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9
Sep 09 13:17:37 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:38 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9" returned: 0 in 0.793s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:38 devstack sudo[94884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9
Sep 09 13:17:38 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:38 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38f75290-cb47-43da-b223-8ca7524d99e9" returned: 0 in 0.329s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "cinder-quobyte-38f75290-cb47-43da-b223-8ca7524d99e9" released by "delete_volume" :: held 1.212s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Created reservations ['d58b374e-0397-40a3-8c76-6edcf2bfeec0', 'e789890b-8c02-4776-a786-08a183b166de', 'c014811d-f5fb-4368-93c3-4d11fbeb5364', '2cf50672-3915-4143-8dd4-5f5c4302cc75'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:38 devstack sudo[94888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:38 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:39 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:39 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Deleted volume successfully.
Sep 09 13:17:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45c28c30-af88-4f24-8e3a-840593830099 tempest-VolumesCloneNegativeTest-603158528 None] Lock "cinder-38f75290-cb47-43da-b223-8ca7524d99e9-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (b3695fad-e917-4005-b21d-2d860f918bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb63ee2-7cec-42e4-8acd-9ad76e4356d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb63ee2-7cec-42e4-8acd-9ad76e4356d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076834018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78155bec-e0bf-4885-95aa-3e9ef103a8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:41Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faefe1ac-eab3-406a-acdf-8b06a337922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faefe1ac-eab3-406a-acdf-8b06a337922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ea2c20-05e3-4c86-8249-b01711d1d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ea2c20-05e3-4c86-8249-b01711d1d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78155bec-e0bf-4885-95aa-3e9ef103a8f0', 'volume_name': 'volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f17160-f800-40eb-b389-62784aea2af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f17160-f800-40eb-b389-62784aea2af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43be546-7e52-4bde-85e5-1d5e5559afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:40 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Volume 78155bec-e0bf-4885-95aa-3e9ef103a8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0', 'volume_size': 1}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076834018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78155bec-e0bf-4885-95aa-3e9ef103a8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:41Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Creating volume 78155bec-e0bf-4885-95aa-3e9ef103a8f0 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:41 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 1073741824
Sep 09 13:17:41 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:41 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 1073741824" returned: 0 in 0.571s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:41 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0
Sep 09 13:17:41 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:41 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0" returned: 0 in 0.385s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43be546-7e52-4bde-85e5-1d5e5559afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920498cc-6805-4833-a28c-8c674732be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:42 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Volume volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 (78155bec-e0bf-4885-95aa-3e9ef103a8f0): created successfully
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920498cc-6805-4833-a28c-8c674732be6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (b3695fad-e917-4005-b21d-2d860f918bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5c546765-ba2e-4c14-9d45-838c2c958a1f tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:17:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0b04354f-3c68-47fd-b8e7-bbc9e4e07dda tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0" by "attach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0b04354f-3c68-47fd-b8e7-bbc9e4e07dda tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0" acquired by "attach_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0b04354f-3c68-47fd-b8e7-bbc9e4e07dda tempest-VolumesActionsTest-1500734275 None] Attaching volume 78155bec-e0bf-4885-95aa-3e9ef103a8f0 to instance 5324b4ed-0087-431c-aca1-00b8172e0bd2 at mountpoint /dev/vdb on host None.
Sep 09 13:17:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0b04354f-3c68-47fd-b8e7-bbc9e4e07dda tempest-VolumesActionsTest-1500734275 None] Attach volume completed successfully.
Sep 09 13:17:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0b04354f-3c68-47fd-b8e7-bbc9e4e07dda tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0" released by "attach_volume" :: held 0.239s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Terminate volume connection completed successfully.
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" by "detach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Detaching volume 78155bec-e0bf-4885-95aa-3e9ef103a8f0 from instance 5324b4ed-0087-431c-aca1-00b8172e0bd2.
Sep 09 13:17:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Detach volume completed successfully.
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-da397c39-047d-43fd-8ee8-577e2180e880 tempest-VolumesActionsTest-424692691 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" released by "detach_volume" :: held 0.232s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5c4bf40b-a832-4b13-bfdd-350690ea8fc8 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" by "detach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5c4bf40b-a832-4b13-bfdd-350690ea8fc8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5c4bf40b-a832-4b13-bfdd-350690ea8fc8 tempest-VolumesActionsTest-1500734275 None] Volume detach called, but volume not attached.
Sep 09 13:17:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5c4bf40b-a832-4b13-bfdd-350690ea8fc8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-quobyte-78155bec-e0bf-4885-95aa-3e9ef103a8f0" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-quobyte-78155bec-e0bf-4885-95aa-3e9ef103a8f0" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd69c692-dbd0-49cb-b3dc-850578563424]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:46 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0
Sep 09 13:17:46 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Flow 'volume_create_manager' (6cd0d33e-e2ab-45b4-b112-ed86108de342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb41868-e049-4a13-a735-c21b4ccefa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb41868-e049-4a13-a735-c21b4ccefa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2028336096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fe9fef-c6e4-4cb4-b512-6e7870c0c308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0088db3580144e2eaf84bcaf28bb6126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:47Z,use_quota=True,user_id='606ed559b83147a8ae25c242cb297e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efb368e-07c4-4738-8338-ee7696b82c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efb368e-07c4-4738-8338-ee7696b82c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f46490-22b5-46c2-a130-be29aaa642cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:17:47 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0" returned: 0 in 0.913s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:47 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0
Sep 09 13:17:47 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f46490-22b5-46c2-a130-be29aaa642cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08fe9fef-c6e4-4cb4-b512-6e7870c0c308', 'volume_name': 'volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460559d0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac09757f-fcbc-442d-a23d-7227763a3b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac09757f-fcbc-442d-a23d-7227763a3b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:48 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75f6b5-096d-4f82-b103-6c9a380bbfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460559d0>}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Trying to clone 08fe9fef-c6e4-4cb4-b512-6e7870c0c308 from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-78155bec-e0bf-4885-95aa-3e9ef103a8f0" returned: 0 in 0.595s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-quobyte-78155bec-e0bf-4885-95aa-3e9ef103a8f0" released by "delete_volume" :: held 1.596s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Created reservations ['5c029fb3-31c5-4e85-9749-f0bd7f5fbb0e', 'c01f8a52-da77-4942-80fb-e9c16d04c9a9', '2071dd20-1e7b-444d-afd6-13e38e95962e', '6e03971e-ddec-432e-b1f0-9c4c263371a5'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:48 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:48 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:48 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:17:48 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.364s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Deleted volume successfully.
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7df6f583-d66b-4750-9b74-8b04a9d39da8 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-78155bec-e0bf-4885-95aa-3e9ef103a8f0-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eac0dc-efe4-4537-a7be-bf62c0b07295]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:49 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD
Sep 09 13:17:49 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:49 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:49 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 is fetched for user 606ed559b83147a8ae25c242cb297e9d. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:17:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a625f-393a-4117-9b20-e94b805c9391]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:50 devstack sudo[94969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD
Sep 09 13:17:50 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:50 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2028336096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fe9fef-c6e4-4cb4-b512-6e7870c0c308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0088db3580144e2eaf84bcaf28bb6126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:47Z,use_quota=True,user_id='606ed559b83147a8ae25c242cb297e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Creating volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:50 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:50 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1073741824
Sep 09 13:17:50 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Acquiring lock "cinder-3ce089b2-f5cc-4bf7-88a6-454fda37eae6-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "cinder-3ce089b2-f5cc-4bf7-88a6-454fda37eae6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Acquiring lock "cinder-quobyte-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "cinder-quobyte-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ad387f-050f-40e6-bae8-78adf61e0fb9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:51 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6
Sep 09 13:17:51 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:51 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1073741824" returned: 0 in 0.910s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:51 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" returned: 0 in 0.600s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:51 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308
Sep 09 13:17:51 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:51 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6
Sep 09 13:17:51 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:51 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" returned: 0 in 0.441s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Attempting download of 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:17:51 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" returned: 0 in 0.483s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "cinder-quobyte-3ce089b2-f5cc-4bf7-88a6-454fda37eae6" released by "delete_volume" :: held 1.165s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[788575dd-7304-4554-9757-9d783d14a3b5]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Created reservations ['e718bca8-9ec2-4284-8e75-2b925a5e6abb', '3e5de894-f25c-4087-b493-92dfbb05971c', '3fa636f1-014b-41cc-8ef7-979a4ab2fd9d', 'c0f30a62-1bc8-43ed-a1db-aefdaffd71ed'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:52 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f
Sep 09 13:17:52 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:52 devstack sudo[95015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:52 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:52 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f" returned: 0 in 0.465s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:52 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.305s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Deleted volume successfully.
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c554acf0-d54d-496a-a993-dcd3aeb8731f tempest-AttachVolumeShelveTestJSON-895971606 None] Lock "cinder-3ce089b2-f5cc-4bf7-88a6-454fda37eae6-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:52 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f
Sep 09 13:17:52 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:52 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f" returned: 1 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_6ss_q05f' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366dd1a-e664-43c8-aff6-a71b3f22dec8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:52 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD
Sep 09 13:17:52 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:53 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] 11a0fc37-23e8-4a61-8370-95b767ddcca5 was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:53 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308
Sep 09 13:17:53 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (53965489-fa07-4d87-843a-3cd393ea502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d804ea4-4268-4762-ad7b-4ad4ac023d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d804ea4-4268-4762-ad7b-4ad4ac023d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484423137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ac944c-3baf-4e19-872a-0bef36bf8771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:53Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bd5029-6809-473f-9fb4-d752582635d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bd5029-6809-473f-9fb4-d752582635d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1176359f-2d23-4c09-b145-5a819ffd9255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1176359f-2d23-4c09-b145-5a819ffd9255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ac944c-3baf-4e19-872a-0bef36bf8771', 'volume_name': 'volume-51ac944c-3baf-4e19-872a-0bef36bf8771', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587e4e95-ca2a-41e7-81f1-85d804f8c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587e4e95-ca2a-41e7-81f1-85d804f8c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47dac26-03de-4fc4-a750-4a029a671f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:53 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Volume 51ac944c-3baf-4e19-872a-0bef36bf8771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ac944c-3baf-4e19-872a-0bef36bf8771', 'volume_size': 1}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-484423137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ac944c-3baf-4e19-872a-0bef36bf8771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:53Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Creating volume 51ac944c-3baf-4e19-872a-0bef36bf8771 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:53 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:53 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 1073741824
Sep 09 13:17:53 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:54 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 1073741824" returned: 0 in 0.585s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:54 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771
Sep 09 13:17:54 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:54 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771" returned: 0 in 0.481s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47dac26-03de-4fc4-a750-4a029a671f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ac944c-3baf-4e19-872a-0bef36bf8771', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b490c8-a24c-4990-99c8-16a41a469f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Volume volume-51ac944c-3baf-4e19-872a-0bef36bf8771 (51ac944c-3baf-4e19-872a-0bef36bf8771): created successfully
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b490c8-a24c-4990-99c8-16a41a469f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (53965489-fa07-4d87-843a-3cd393ea502a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0506a9cf-b3bb-4a6c-9c2e-033ebf5accb3 tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:17:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-51ac944c-3baf-4e19-872a-0bef36bf8771-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "cinder-51ac944c-3baf-4e19-872a-0bef36bf8771-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-quobyte-51ac944c-3baf-4e19-872a-0bef36bf8771" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-51ac944c-3baf-4e19-872a-0bef36bf8771" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[695c199f-8ea9-4042-a0bf-eba5d672f2ee]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:56 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" returned: 0 in 2.973s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_mw03sr5tdevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:17:56 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Converted 112.00 MB image at 37.66 MB/s
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:56 devstack sudo[95117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1G
Sep 09 13:17:56 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:56 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771
Sep 09 13:17:56 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:56 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771" returned: 0 in 0.726s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:56 devstack sudo[95128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771
Sep 09 13:17:56 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:56 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 1G" returned: 0 in 0.706s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Downloaded image 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:17:56 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 for user 606ed559b83147a8ae25c242cb297e9d is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Marking volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Copying metadata from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 to 08fe9fef-c6e4-4cb4-b512-6e7870c0c308. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Creating volume glance metadata for volume 08fe9fef-c6e4-4cb4-b512-6e7870c0c308 backed by image 11a0fc37-23e8-4a61-8370-95b767ddcca5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75f6b5-096d-4f82-b103-6c9a380bbfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460559d0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1af4a2-a68e-4385-88a3-80041e176dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Volume volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 (08fe9fef-c6e4-4cb4-b512-6e7870c0c308): created successfully
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1af4a2-a68e-4385-88a3-80041e176dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Flow 'volume_create_manager' (6cd0d33e-e2ab-45b4-b112-ed86108de342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f214539c-5496-4284-bef5-76c11d420e0a tempest-VolumesExtendTest-1602196630 None] Created volume successfully.
Sep 09 13:17:57 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-51ac944c-3baf-4e19-872a-0bef36bf8771" returned: 0 in 0.552s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-51ac944c-3baf-4e19-872a-0bef36bf8771" released by "delete_volume" :: held 1.362s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Created reservations ['ea7c97e9-33c1-450d-ada4-6edb728c8ae4', '1d6b8bc0-172b-4fae-a060-f4faa75d16d2', '195c5574-8ebe-4789-961a-f1dfb9ea179a', '33667201-0e70-49f0-968a-89068085b3e2'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:57 devstack sudo[95133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:17:57 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:57 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.314s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:17:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Deleted volume successfully.
Sep 09 13:17:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7427d3cf-90e4-4287-ab8b-9d2558bda9fd tempest-VolumesActionsTest-424692691 None] Lock "cinder-51ac944c-3baf-4e19-872a-0bef36bf8771-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:17:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:58 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f228c-8098-4674-8ae5-65f7a4299b66]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:17:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:58 devstack sudo[95137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308
Sep 09 13:17:58 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (11066fd7-be05-46ba-a2fa-ad2fdf1e1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df96be73-ac99-4700-b58a-b2bf94f89d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df96be73-ac99-4700-b58a-b2bf94f89d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819596935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9719fc0b-90a5-4058-944e-4df96a9b6dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:59Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc3a661-68c3-4604-b8cc-7007469a3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc3a661-68c3-4604-b8cc-7007469a3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07209065-555d-49f0-9dfd-cb79e4564385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07209065-555d-49f0-9dfd-cb79e4564385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9719fc0b-90a5-4058-944e-4df96a9b6dba', 'volume_name': 'volume-9719fc0b-90a5-4058-944e-4df96a9b6dba', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f8cb81-5b9c-4b87-8570-22d3f20d2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f8cb81-5b9c-4b87-8570-22d3f20d2432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54223797-57b1-46df-a221-6ae61b515f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:17:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Volume 9719fc0b-90a5-4058-944e-4df96a9b6dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9719fc0b-90a5-4058-944e-4df96a9b6dba', 'volume_size': 1}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:59 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" returned: 0 in 0.803s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 2G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 2G" returned: 0 in 0.114s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.972s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819596935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9719fc0b-90a5-4058-944e-4df96a9b6dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:17:59Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Creating volume 9719fc0b-90a5-4058-944e-4df96a9b6dba {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:17:59 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:17:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:17:59 devstack sudo[95147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba 1073741824
Sep 09 13:17:59 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:17:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8fac62fd-ad37-46a5-93ef-8989779efe2a tempest-VolumesExtendTest-1602196630 None] Extend volume completed successfully.
Sep 09 13:18:00 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba 1073741824" returned: 0 in 0.618s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:00 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba
Sep 09 13:18:00 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:00 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba" returned: 0 in 0.417s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54223797-57b1-46df-a221-6ae61b515f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9719fc0b-90a5-4058-944e-4df96a9b6dba', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2079dc8d-dcb9-4994-9971-aae667bcb42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:00 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Volume volume-9719fc0b-90a5-4058-944e-4df96a9b6dba (9719fc0b-90a5-4058-944e-4df96a9b6dba): created successfully
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2079dc8d-dcb9-4994-9971-aae667bcb42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (11066fd7-be05-46ba-a2fa-ad2fdf1e1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:00 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cdbf6778-caf5-499d-ba51-14bfa9a68da3 tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-9719fc0b-90a5-4058-944e-4df96a9b6dba-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "cinder-9719fc0b-90a5-4058-944e-4df96a9b6dba-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-quobyte-9719fc0b-90a5-4058-944e-4df96a9b6dba" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-9719fc0b-90a5-4058-944e-4df96a9b6dba" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a238a-0909-4f83-a553-674b13cb3f0c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:01 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba
Sep 09 13:18:01 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-08fe9fef-c6e4-4cb4-b512-6e7870c0c308-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-08fe9fef-c6e4-4cb4-b512-6e7870c0c308-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-quobyte-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d7ce1-3614-4c77-8fa5-6253393a1949]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:02 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308
Sep 09 13:18:02 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:02 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba" returned: 0 in 0.736s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:02 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba
Sep 09 13:18:02 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:03 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" returned: 0 in 0.957s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:03 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9719fc0b-90a5-4058-944e-4df96a9b6dba" returned: 0 in 0.723s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-9719fc0b-90a5-4058-944e-4df96a9b6dba" released by "delete_volume" :: held 1.582s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:03 devstack sudo[95177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308
Sep 09 13:18:03 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Created reservations ['8caf2065-bedc-4b28-bb5b-4d6bd3cd35bf', '76e31b01-5557-4924-b333-b92e021ceab0', 'd125a787-a03b-46e3-9e5d-87442497bd7f', '1202ab39-fff1-4842-90c4-56d69f0ecf1b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:03 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:03 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:03 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" returned: 0 in 0.589s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-08fe9fef-c6e4-4cb4-b512-6e7870c0c308" released by "delete_volume" :: held 1.641s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Created reservations ['5195d362-8e7f-4193-bb19-96d2ac96a926', 'ef077f08-6743-48a7-bff8-312c45378950', 'dd594eb7-8efc-4550-a814-1fdadd959840', 'c63fa478-eaf8-47d1-9454-151552af47bb'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:04 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:04 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:04 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.705s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Deleted volume successfully.
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8a7e9011-9a4e-4a51-b897-dc7d2454988d tempest-VolumesActionsTest-424692691 None] Lock "cinder-9719fc0b-90a5-4058-944e-4df96a9b6dba-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:04 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Deleted volume successfully.
Sep 09 13:18:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5f55a06-d533-4ec7-bc6c-8ecdb7b41476 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-08fe9fef-c6e4-4cb4-b512-6e7870c0c308-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (bd8d2546-4d36-40d5-8f09-23b653e570b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2f8737-6e7b-4f3e-abd0-80701d463708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2f8737-6e7b-4f3e-abd0-80701d463708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704690168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ba03e-e30b-48e9-8e14-8f4574a648cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:05Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c16b94-1500-44fc-b4b1-5b8cd049b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c16b94-1500-44fc-b4b1-5b8cd049b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36448781-f069-4ea0-aac9-a6e3640d9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36448781-f069-4ea0-aac9-a6e3640d9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28ba03e-e30b-48e9-8e14-8f4574a648cd', 'volume_name': 'volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035402e-92b5-45cb-9a77-31fa815d0772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035402e-92b5-45cb-9a77-31fa815d0772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c383d1d-a18f-4661-ab73-4cd8b3608708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Volume f28ba03e-e30b-48e9-8e14-8f4574a648cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd', 'volume_size': 1}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704690168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ba03e-e30b-48e9-8e14-8f4574a648cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:05Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Creating volume f28ba03e-e30b-48e9-8e14-8f4574a648cd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:05 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:05 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd 1073741824
Sep 09 13:18:05 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Flow 'volume_create_manager' (fc8a1563-1283-498d-b6b1-0d2ffb250b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30995c47-5549-4da8-85ed-54abe06e5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30995c47-5549-4da8-85ed-54abe06e5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1153555977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da566ec-761d-4f27-94a3-ce059d88ae2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0088db3580144e2eaf84bcaf28bb6126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:06Z,use_quota=True,user_id='606ed559b83147a8ae25c242cb297e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9619cf38-81ef-40bf-bde3-515c73a6dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9619cf38-81ef-40bf-bde3-515c73a6dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d39dd6e-40a5-4954-91a0-09c2f02a5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d39dd6e-40a5-4954-91a0-09c2f02a5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da566ec-761d-4f27-94a3-ce059d88ae2c', 'volume_name': 'volume-3da566ec-761d-4f27-94a3-ce059d88ae2c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d613b-7ddf-46c4-8d27-ee61901d23b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d613b-7ddf-46c4-8d27-ee61901d23b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54757a89-b1dc-4fb9-b9b3-8fbd9f115974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:05 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Volume 3da566ec-761d-4f27-94a3-ce059d88ae2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da566ec-761d-4f27-94a3-ce059d88ae2c', 'volume_size': 1}
Sep 09 13:18:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:06 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd 1073741824" returned: 0 in 0.618s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:06 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd
Sep 09 13:18:06 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:06 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd" returned: 0 in 0.420s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1153555977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da566ec-761d-4f27-94a3-ce059d88ae2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0088db3580144e2eaf84bcaf28bb6126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:06Z,use_quota=True,user_id='606ed559b83147a8ae25c242cb297e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Creating volume 3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:06 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c383d1d-a18f-4661-ab73-4cd8b3608708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:06 devstack sudo[95207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c 1073741824
Sep 09 13:18:06 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76b6363-b62d-406f-b50f-7d2b611a546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:06 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Volume volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd (f28ba03e-e30b-48e9-8e14-8f4574a648cd): created successfully
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76b6363-b62d-406f-b50f-7d2b611a546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (bd8d2546-4d36-40d5-8f09-23b653e570b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6836dd31-228d-4711-91e8-eb6b2fe9e694 tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:18:07 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c 1073741824" returned: 0 in 0.676s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:07 devstack sudo[95214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:07 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-f28ba03e-e30b-48e9-8e14-8f4574a648cd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "cinder-f28ba03e-e30b-48e9-8e14-8f4574a648cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-quobyte-f28ba03e-e30b-48e9-8e14-8f4574a648cd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-f28ba03e-e30b-48e9-8e14-8f4574a648cd" acquired by "delete_volume" :: waited 0.046s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:08 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.816s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc7a49c-6d03-4be7-8d49-027f92bc6fd1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54757a89-b1dc-4fb9-b9b3-8fbd9f115974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da566ec-761d-4f27-94a3-ce059d88ae2c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eee9e0-4ad4-4270-a392-ead4c023919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:08 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Volume volume-3da566ec-761d-4f27-94a3-ce059d88ae2c (3da566ec-761d-4f27-94a3-ce059d88ae2c): created successfully
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eee9e0-4ad4-4270-a392-ead4c023919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Flow 'volume_create_manager' (fc8a1563-1283-498d-b6b1-0d2ffb250b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-82886b38-4ac1-48bd-adcc-5d3735a85f86 tempest-VolumesExtendTest-1602196630 None] Created volume successfully.
Sep 09 13:18:08 devstack sudo[95231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd
Sep 09 13:18:08 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7476bc7-1965-4aac-adbe-1bd3496fa801 tempest-BackendsCapabilitiesAdminTestsJSON-1663522567 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3740043640137, 'free_capacity_gb': 1773.3740043640137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87606) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 13:18:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-8d824d0a-f878-4e88-b1eb-2ed8a34a02a6 tempest-BackendsCapabilitiesAdminTestsJSON-1663522567 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3740043640137, 'free_capacity_gb': 1773.3740043640137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87606) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 13:18:09 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd" returned: 0 in 0.980s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:09 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd
Sep 09 13:18:09 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Creating offline snapshot a87c542e-55d6-4ad0-9706-48c3796f797e of volume 3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:09 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea8ed2-6262-4c11-9525-ed931900c7c8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f28ba03e-e30b-48e9-8e14-8f4574a648cd" returned: 0 in 0.596s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-f28ba03e-e30b-48e9-8e14-8f4574a648cd" released by "delete_volume" :: held 1.718s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:09 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Created reservations ['2a024062-c142-44de-85f7-ee3eb543889b', '54d6f016-97af-453d-a733-6a15212396b8', 'c1393018-5cde-4706-a10f-f2c55585229e', '9ae098ce-8838-48b5-a07b-4f7125a822b5'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:10 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:10 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:10 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:10 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:10 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.793s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:10 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.551s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:10 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e 1G
Sep 09 13:18:10 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Deleted volume successfully.
Sep 09 13:18:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-49c3309b-5eef-47c5-b699-14e7858b522d tempest-VolumesActionsTest-424692691 None] Lock "cinder-f28ba03e-e30b-48e9-8e14-8f4574a648cd-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:11 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e 1G" returned: 0 in 0.794s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da566ec-761d-4f27-94a3-ce059d88ae2c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:11 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da566ec-761d-4f27-94a3-ce059d88ae2c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e
Sep 09 13:18:11 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (38ac7047-d22f-4890-8416-e653d3619f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6129d0f0-7900-43e6-9ea9-553ec9033673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6129d0f0-7900-43e6-9ea9-553ec9033673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105908102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f7c7af-f984-4558-9e59-1389da73ae93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:12Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be1b3da-a19c-4aa9-91b0-1523ac88b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be1b3da-a19c-4aa9-91b0-1523ac88b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da24cdc-93fd-4cdc-95a2-5820657d07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da24cdc-93fd-4cdc-95a2-5820657d07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f7c7af-f984-4558-9e59-1389da73ae93', 'volume_name': 'volume-05f7c7af-f984-4558-9e59-1389da73ae93', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f493a9-286f-462a-a0d5-9efb7a6cfe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f493a9-286f-462a-a0d5-9efb7a6cfe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5313dd37-248c-442f-806c-5544ab80f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:11 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Volume 05f7c7af-f984-4558-9e59-1389da73ae93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f7c7af-f984-4558-9e59-1389da73ae93', 'volume_size': 1}
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:11 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da566ec-761d-4f27-94a3-ce059d88ae2c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e" returned: 0 in 0.530s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:11 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e is being set with open permissions: ugo+rw
Sep 09 13:18:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:11 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e
Sep 09 13:18:11 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:12 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e" returned: 0 in 0.361s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:12 devstack sudo[95314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info
Sep 09 13:18:12 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:12 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:12 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info is being set with open permissions: ugo+rw
Sep 09 13:18:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:12 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info
Sep 09 13:18:12 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:13 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.info" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105908102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f7c7af-f984-4558-9e59-1389da73ae93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:12Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Creating volume 05f7c7af-f984-4558-9e59-1389da73ae93 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:13 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:13 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 1073741824
Sep 09 13:18:13 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e3c3eb63-d079-419c-9f6a-07befa56187d tempest-VolumesExtendTest-1602196630 None] Create snapshot completed successfully
Sep 09 13:18:13 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 1073741824" returned: 0 in 0.642s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:13 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93
Sep 09 13:18:13 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:14 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93" returned: 0 in 0.406s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5313dd37-248c-442f-806c-5544ab80f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f7c7af-f984-4558-9e59-1389da73ae93', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c1064c-5962-4f6b-8818-4e9edeed3bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[20534368-9641-4355-9c0f-76f7ff468a22]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:14 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Volume volume-05f7c7af-f984-4558-9e59-1389da73ae93 (05f7c7af-f984-4558-9e59-1389da73ae93): created successfully
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c1064c-5962-4f6b-8818-4e9edeed3bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (38ac7047-d22f-4890-8416-e653d3619f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e6554803-732f-435a-b79e-34147185a6e9 tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:18:14 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:14 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:14 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.448s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e 2G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-05f7c7af-f984-4558-9e59-1389da73ae93-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e 2G" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.771s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "cinder-05f7c7af-f984-4558-9e59-1389da73ae93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Acquiring lock "cinder-quobyte-05f7c7af-f984-4558-9e59-1389da73ae93" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-03bc229f-c2ac-4c51-8cb3-b123630f1316 tempest-VolumesExtendTest-1602196630 None] Extend volume completed successfully.
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-05f7c7af-f984-4558-9e59-1389da73ae93" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7c963-1294-444f-bd93-bd96bfc6939f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:15 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93
Sep 09 13:18:15 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:15 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-a87c542e-55d6-4ad0-9706-48c3796f797e-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93" returned: 0 in 0.441s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-a87c542e-55d6-4ad0-9706-48c3796f797e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:15 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93
Sep 09 13:18:15 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-quobyte-a87c542e-55d6-4ad0-9706-48c3796f797e" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-a87c542e-55d6-4ad0-9706-48c3796f797e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Deleting offline snapshot a87c542e-55d6-4ad0-9706-48c3796f797e of volume 3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] snapshot_file for this snap is: volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2283df8-4307-449d-865e-a56b240becae]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:15 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e
Sep 09 13:18:15 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:15 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05f7c7af-f984-4558-9e59-1389da73ae93" returned: 0 in 0.313s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "cinder-quobyte-05f7c7af-f984-4558-9e59-1389da73ae93" released by "delete_volume" :: held 0.809s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Created reservations ['a3a956ad-abb4-499d-9401-1535bb02eeec', 'b37e40a2-c4c7-4149-bbad-643cfd35d323', 'ae3d1c4c-c937-4f3c-9f8f-5d37866ee173', '0597082b-2713-49b6-977a-54d7a914b150'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:16 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:16 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:16 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e" returned: 0 in 0.581s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da566ec-761d-4f27-94a3-ce059d88ae2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e0627-276e-4a15-9c20-1a720c7d889e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Flow 'volume_create_manager' (e3cdc8c9-9e6c-45b0-993a-d09361189739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b0d74-9af6-4853-bd3d-eddc6375be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b0d74-9af6-4853-bd3d-eddc6375be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-514404760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea9c98f-872d-42f0-bab9-e373795e8f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86929f18a643619aeef8d02e306481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:16Z,use_quota=True,user_id='9cf46ae9e1f84edd99862c64d90fe8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4592a03-a622-44b4-bb8c-198bbde62667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4592a03-a622-44b4-bb8c-198bbde62667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c32e376-db67-48bc-88aa-bc2ad78dd173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c32e376-db67-48bc-88aa-bc2ad78dd173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea9c98f-872d-42f0-bab9-e373795e8f17', 'volume_name': 'volume-fea9c98f-872d-42f0-bab9-e373795e8f17', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef949f59-008d-4600-a4a3-3bf68855fba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef949f59-008d-4600-a4a3-3bf68855fba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965f9823-e10f-4c92-9a95-5b7388b02df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:16 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Volume fea9c98f-872d-42f0-bab9-e373795e8f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea9c98f-872d-42f0-bab9-e373795e8f17', 'volume_size': 1}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-514404760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea9c98f-872d-42f0-bab9-e373795e8f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86929f18a643619aeef8d02e306481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:16Z,use_quota=True,user_id='9cf46ae9e1f84edd99862c64d90fe8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Creating volume fea9c98f-872d-42f0-bab9-e373795e8f17 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:16 devstack sudo[95419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:16 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:16 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:16 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 1073741824
Sep 09 13:18:16 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:16 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.443s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Deleted volume successfully.
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b83e9c7-3b5b-467d-a4d1-ce35b61ec258 tempest-VolumesActionsTest-424692691 None] Lock "cinder-05f7c7af-f984-4558-9e59-1389da73ae93-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:16 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.492s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:16 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e
Sep 09 13:18:16 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (d17fa02d-7e43-440b-a28c-35143622ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8a63b7-d23f-46bd-bb27-692117b24fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8a63b7-d23f-46bd-bb27-692117b24fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549365847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720cfbc7-eddf-45ad-ad38-33ce02517083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:17Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c87bf0-b06d-48c5-938e-a554e264d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c87bf0-b06d-48c5-938e-a554e264d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f8586f-3f06-43f7-ae3a-9f70204e0173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f8586f-3f06-43f7-ae3a-9f70204e0173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720cfbc7-eddf-45ad-ad38-33ce02517083', 'volume_name': 'volume-720cfbc7-eddf-45ad-ad38-33ce02517083', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab14f1ee-be81-4954-a1be-8cc953811e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab14f1ee-be81-4954-a1be-8cc953811e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a021584a-6af4-478e-9768-169cca0b8973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Volume 720cfbc7-eddf-45ad-ad38-33ce02517083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720cfbc7-eddf-45ad-ad38-33ce02517083', 'volume_size': 1}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:17 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 1073741824" returned: 0 in 0.800s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:17 devstack sudo[95437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17
Sep 09 13:18:17 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:17 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e" returned: 0 in 0.585s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:17 devstack sudo[95439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e
Sep 09 13:18:17 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:17 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549365847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720cfbc7-eddf-45ad-ad38-33ce02517083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecdbe696a6974c86bb79db706d797cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:17Z,use_quota=True,user_id='a90e4aba3891401ea20dc87468c24b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Creating volume 720cfbc7-eddf-45ad-ad38-33ce02517083 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:17 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:17 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 1073741824
Sep 09 13:18:17 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965f9823-e10f-4c92-9a95-5b7388b02df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea9c98f-872d-42f0-bab9-e373795e8f17', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96113648-1c17-4978-91c6-bd0dce2009a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:17 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c.a87c542e-55d6-4ad0-9706-48c3796f797e" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Volume volume-fea9c98f-872d-42f0-bab9-e373795e8f17 (fea9c98f-872d-42f0-bab9-e373795e8f17): created successfully
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96113648-1c17-4978-91c6-bd0dce2009a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Flow 'volume_create_manager' (e3cdc8c9-9e6c-45b0-993a-d09361189739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:17 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b411d837-28b0-470f-954d-14d3d6a60d72 tempest-ServersNegativeTestJSON-56112025 None] Created volume successfully.
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-a87c542e-55d6-4ad0-9706-48c3796f797e" released by "_delete_snapshot" :: held 2.163s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" released by "delete_snapshot" :: held 2.196s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:17 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Created reservations ['0bce7f01-05cc-4cc1-bab5-71281d98fc6f', '7cbefa2a-8d90-45e2-962a-30ff6223e14d', 'e99e01c3-c9ae-4cb7-a1ad-afb538511590', 'c8fcef43-dea6-485e-be04-4f39dbaa21e8'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Delete snapshot completed successfully.
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-de547280-f933-421f-b329-453659ba6a94 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-a87c542e-55d6-4ad0-9706-48c3796f797e-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:18 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 1073741824" returned: 0 in 0.634s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:18 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083
Sep 09 13:18:18 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:18 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083" returned: 0 in 0.284s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a021584a-6af4-478e-9768-169cca0b8973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720cfbc7-eddf-45ad-ad38-33ce02517083', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6ebc2e-9f33-40fb-b41a-64b0ff3905ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:18 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Volume volume-720cfbc7-eddf-45ad-ad38-33ce02517083 (720cfbc7-eddf-45ad-ad38-33ce02517083): created successfully
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6ebc2e-9f33-40fb-b41a-64b0ff3905ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Flow 'volume_create_manager' (d17fa02d-7e43-440b-a28c-35143622ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cce5ea6d-964a-4b3f-98b7-ec20c8a7a355 tempest-VolumesActionsTest-1500734275 None] Created volume successfully.
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-3da566ec-761d-4f27-94a3-ce059d88ae2c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-3da566ec-761d-4f27-94a3-ce059d88ae2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e0c02-5114-4ef9-8562-48d43e31c4bd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:19 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:19 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:19 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:19 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c
Sep 09 13:18:19 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:20 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3da566ec-761d-4f27-94a3-ce059d88ae2c" returned: 0 in 0.416s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-quobyte-3da566ec-761d-4f27-94a3-ce059d88ae2c" released by "delete_volume" :: held 1.026s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Created reservations ['2128e344-0ead-4196-98f1-7ddcd744d7f6', 'edfad668-36c0-4f63-9336-37d9c5d75646', '78644d62-ad05-4576-b03b-0f203380d446', '18684a61-c3b5-4f22-97ca-52675d2ccae3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Flow 'volume_create_manager' (4dd6687e-4b45-43a6-a188-d5aad8c9adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b66025-3734-498e-9b0e-1c9aab7aec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b66025-3734-498e-9b0e-1c9aab7aec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1961666440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec744f8-72f4-4f71-86dc-89b04b128f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86929f18a643619aeef8d02e306481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:20Z,use_quota=True,user_id='9cf46ae9e1f84edd99862c64d90fe8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe11382-3131-455d-96e6-1188370aad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe11382-3131-455d-96e6-1188370aad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1362a2c4-1e84-42a9-a866-964cd175d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1362a2c4-1e84-42a9-a866-964cd175d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec744f8-72f4-4f71-86dc-89b04b128f2a', 'volume_name': 'volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d866c06-e85f-481f-8f56-9c420fcf7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d866c06-e85f-481f-8f56-9c420fcf7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab17e2f-0fb2-482f-8484-1bb9364e8c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Volume 1ec744f8-72f4-4f71-86dc-89b04b128f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a', 'volume_size': 1}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1961666440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec744f8-72f4-4f71-86dc-89b04b128f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86929f18a643619aeef8d02e306481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:20Z,use_quota=True,user_id='9cf46ae9e1f84edd99862c64d90fe8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Creating volume 1ec744f8-72f4-4f71-86dc-89b04b128f2a {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:20 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:20 devstack sudo[95462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a 1073741824
Sep 09 13:18:20 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:20 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:20 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-720cfbc7-eddf-45ad-ad38-33ce02517083-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-720cfbc7-eddf-45ad-ad38-33ce02517083-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "cinder-quobyte-720cfbc7-eddf-45ad-ad38-33ce02517083" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-quobyte-720cfbc7-eddf-45ad-ad38-33ce02517083" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32296f-3261-45b0-936b-9646265ecbce]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:20 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:20 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083
Sep 09 13:18:20 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Deleted volume successfully.
Sep 09 13:18:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-804d914d-0a0a-4d98-a45c-5d3e1905b575 tempest-VolumesExtendTest-1602196630 None] Lock "cinder-3da566ec-761d-4f27-94a3-ce059d88ae2c-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:21 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a 1073741824" returned: 0 in 0.616s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:21 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a
Sep 09 13:18:21 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:21 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083" returned: 0 in 0.486s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:21 devstack sudo[95479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083
Sep 09 13:18:21 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:21 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a" returned: 0 in 0.373s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab17e2f-0fb2-482f-8484-1bb9364e8c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e923ca14-a51c-48ec-b134-ef98f664c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Volume volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a (1ec744f8-72f4-4f71-86dc-89b04b128f2a): created successfully
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e923ca14-a51c-48ec-b134-ef98f664c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Flow 'volume_create_manager' (4dd6687e-4b45-43a6-a188-d5aad8c9adf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fcfb8c86-cd2c-4a61-919b-4fe8b38de855 tempest-ServersNegativeTestJSON-56112025 None] Created volume successfully.
Sep 09 13:18:21 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-720cfbc7-eddf-45ad-ad38-33ce02517083" returned: 0 in 0.375s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-quobyte-720cfbc7-eddf-45ad-ad38-33ce02517083" released by "delete_volume" :: held 0.903s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Created reservations ['4c494bc4-c4b6-4c0f-9701-3b46491f827f', 'fd441cf0-b618-4445-9918-6f264cd81f21', '2d07719f-13ef-457e-b8ab-e9efbab9fa51', 'cbcb52da-03b7-40a8-bd52-26deaf705025'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:21 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:21 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:22 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.344s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:22 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Deleted volume successfully.
Sep 09 13:18:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4e5b87e6-7af2-4611-a15d-ae6f2ef2a280 tempest-VolumesActionsTest-1500734275 None] Lock "cinder-720cfbc7-eddf-45ad-ad38-33ce02517083-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "cinder-1ec744f8-72f4-4f71-86dc-89b04b128f2a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-1ec744f8-72f4-4f71-86dc-89b04b128f2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "cinder-quobyte-1ec744f8-72f4-4f71-86dc-89b04b128f2a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-quobyte-1ec744f8-72f4-4f71-86dc-89b04b128f2a" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ee54e-3216-425c-a1e9-3d5a4d9c9581]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:23 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a
Sep 09 13:18:23 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:23 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a" returned: 0 in 0.470s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:23 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a
Sep 09 13:18:23 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:23 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ec744f8-72f4-4f71-86dc-89b04b128f2a" returned: 0 in 0.378s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-quobyte-1ec744f8-72f4-4f71-86dc-89b04b128f2a" released by "delete_volume" :: held 0.922s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Created reservations ['a9fcdb35-f858-4673-8a9b-83f008fc365f', '65eef421-832e-46a1-b8f0-3a7d6675231c', '84b7a7f8-4ce4-454f-9e48-2f5a0ea3eb72', 'bf4247d1-830e-4517-a799-d85f8d512f33'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:24 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:24 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "cinder-fea9c98f-872d-42f0-bab9-e373795e8f17-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-fea9c98f-872d-42f0-bab9-e373795e8f17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "cinder-quobyte-fea9c98f-872d-42f0-bab9-e373795e8f17" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-quobyte-fea9c98f-872d-42f0-bab9-e373795e8f17" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d4785-8ce6-4016-8e76-ad9ed47f451a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:24 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.436s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Deleted volume successfully.
Sep 09 13:18:24 devstack sudo[95506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17
Sep 09 13:18:24 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-89148a52-b76e-4856-b86a-809735672c5f tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-1ec744f8-72f4-4f71-86dc-89b04b128f2a-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:25 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17" returned: 0 in 0.648s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:25 devstack sudo[95513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17
Sep 09 13:18:25 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:25 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fea9c98f-872d-42f0-bab9-e373795e8f17" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:25 devstack sudo[95516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:25 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-quobyte-fea9c98f-872d-42f0-bab9-e373795e8f17" released by "delete_volume" :: held 1.002s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Created reservations ['f274a36e-c04f-42c5-9710-a37039d7af30', 'daf7d987-1281-4c25-9ff0-7da8faa58e2d', '771d1093-1974-4fbe-9670-459d40ac4b47', '650aa2bb-2341-43ef-be59-3fde00637501'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:25 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:25 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:25 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.428s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:18:25 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.312s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Deleted volume successfully.
Sep 09 13:18:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-53e42ce7-0cba-4346-8732-b7c24a8337f4 tempest-ServersNegativeTestJSON-56112025 None] Lock "cinder-fea9c98f-872d-42f0-bab9-e373795e8f17-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Flow 'volume_create_manager' (42dfa9bf-9dc2-4759-aa7e-c6c1f21a39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747b19ab-d750-417c-9907-258b85aa167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747b19ab-d750-417c-9907-258b85aa167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1683747538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6b80a8-cdc5-4fad-ade1-49d9d727db3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db2fcf39c7c422faf711bd1b22dc5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:27Z,use_quota=True,user_id='a49465a6f2794b15aa1008aaae62b49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f220f1-a9b2-48d3-81d0-c3cc80c3fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f220f1-a9b2-48d3-81d0-c3cc80c3fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97193f4-0cc8-4766-b75a-912fc0069aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97193f4-0cc8-4766-b75a-912fc0069aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a6b80a8-cdc5-4fad-ade1-49d9d727db3e', 'volume_name': 'volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ec654d-14cc-48c2-981e-f1a4b1118bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ec654d-14cc-48c2-981e-f1a4b1118bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4f672f-0892-4dae-a40d-16725fb03f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e', 'volume_size': 1}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1683747538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6b80a8-cdc5-4fad-ade1-49d9d727db3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db2fcf39c7c422faf711bd1b22dc5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:27Z,use_quota=True,user_id='a49465a6f2794b15aa1008aaae62b49b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Creating volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:27 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:27 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e 1073741824
Sep 09 13:18:27 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (0e740bf9-4a27-4c3c-b4ec-6942a0a07fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7a644-e07c-41ea-b497-25449d61f8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7a644-e07c-41ea-b497-25449d61f8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-885039882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e56807-2a8f-47db-b31d-c1092a85233c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:27Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdac21b-ec78-4402-be13-149f70fbc8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdac21b-ec78-4402-be13-149f70fbc8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e8cc6-138e-4ac9-9ec8-d5152c9d307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e8cc6-138e-4ac9-9ec8-d5152c9d307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e56807-2a8f-47db-b31d-c1092a85233c', 'volume_name': 'volume-29e56807-2a8f-47db-b31d-c1092a85233c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667071be-d6dc-4ea4-b37e-8055079ec12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667071be-d6dc-4ea4-b37e-8055079ec12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283dd2be-39ed-4ff3-b21e-58338a63059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Volume 29e56807-2a8f-47db-b31d-c1092a85233c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e56807-2a8f-47db-b31d-c1092a85233c', 'volume_size': 1}
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:27 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e 1073741824" returned: 0 in 0.749s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:28 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e
Sep 09 13:18:28 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:28 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-885039882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e56807-2a8f-47db-b31d-c1092a85233c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:27Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Creating volume 29e56807-2a8f-47db-b31d-c1092a85233c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:28 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:28 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c 1073741824
Sep 09 13:18:28 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4f672f-0892-4dae-a40d-16725fb03f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2893709c-63fa-4a48-9186-14c591b424aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Volume volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e (2a6b80a8-cdc5-4fad-ade1-49d9d727db3e): created successfully
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2893709c-63fa-4a48-9186-14c591b424aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Flow 'volume_create_manager' (42dfa9bf-9dc2-4759-aa7e-c6c1f21a39b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7310c13d-43cb-4cbe-8239-1f3c0c144fea tempest-SnapshotsActionsTest-1830497914 None] Created volume successfully.
Sep 09 13:18:29 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c 1073741824" returned: 0 in 0.815s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:29 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c
Sep 09 13:18:29 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:29 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.175s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283dd2be-39ed-4ff3-b21e-58338a63059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e56807-2a8f-47db-b31d-c1092a85233c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29869c54-1bb6-4e3c-ab33-1c9893544422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Creating offline snapshot a4e9a49b-774b-4b5d-96e7-4724ac30fa72 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Volume volume-29e56807-2a8f-47db-b31d-c1092a85233c (29e56807-2a8f-47db-b31d-c1092a85233c): created successfully
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29869c54-1bb6-4e3c-ab33-1c9893544422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (0e740bf9-4a27-4c3c-b4ec-6942a0a07fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db0d22c-6cc3-4ba4-b977-11db331ad676]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-77e39d92-f5ea-4dbf-a0a3-abc304ce9077 tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:18:29 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e
Sep 09 13:18:29 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:29 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" returned: 0 in 0.407s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:30 devstack sudo[95572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 1G
Sep 09 13:18:30 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:30 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 1G" returned: 0 in 0.572s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:30 devstack sudo[95577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:30 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:31 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.490s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:31 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 is being set with open permissions: ugo+rw
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:31 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:31 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (f929ed93-592b-4744-9c50-7395ce2ef09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6275ac1-c298-4ad6-a709-bef3fa413186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6275ac1-c298-4ad6-a709-bef3fa413186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1955351160',display_name='tempest-VolumesGetTest-Volume-671751653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae88aa10-57c4-4301-9438-bfa03458bee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:31Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d7069-83e1-4daa-bfbf-fdd16164626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d7069-83e1-4daa-bfbf-fdd16164626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b2951c-fe28-460b-9227-4be864453c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b2951c-fe28-460b-9227-4be864453c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae88aa10-57c4-4301-9438-bfa03458bee6', 'volume_name': 'volume-ae88aa10-57c4-4301-9438-bfa03458bee6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d8b67-48b0-4bb6-93dd-5f34b650ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d8b67-48b0-4bb6-93dd-5f34b650ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183b2df5-cfa3-4088-9f69-39315996075f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:31 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Volume ae88aa10-57c4-4301-9438-bfa03458bee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae88aa10-57c4-4301-9438-bfa03458bee6', 'volume_size': 1}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:31 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:31 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info
Sep 09 13:18:31 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:31 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info" returned: 0 in 0.284s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:31 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info is being set with open permissions: ugo+rw
Sep 09 13:18:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:31 devstack sudo[95595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info
Sep 09 13:18:31 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:32 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.info" returned: 0 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.555s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1955351160',display_name='tempest-VolumesGetTest-Volume-671751653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae88aa10-57c4-4301-9438-bfa03458bee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:31Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Creating volume ae88aa10-57c4-4301-9438-bfa03458bee6 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:32 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:32 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 1073741824
Sep 09 13:18:32 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cb1bd217-8743-43ba-ae98-d071c5d997ab tempest-SnapshotsActionsTest-1830497914 None] Create snapshot completed successfully
Sep 09 13:18:32 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 1073741824" returned: 0 in 0.542s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:32 devstack sudo[95605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6
Sep 09 13:18:32 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:33 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6" returned: 0 in 0.327s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183b2df5-cfa3-4088-9f69-39315996075f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae88aa10-57c4-4301-9438-bfa03458bee6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af8cba7-e4a8-4bd2-9642-4b53b2255d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Volume volume-ae88aa10-57c4-4301-9438-bfa03458bee6 (ae88aa10-57c4-4301-9438-bfa03458bee6): created successfully
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af8cba7-e4a8-4bd2-9642-4b53b2255d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (f929ed93-592b-4744-9c50-7395ce2ef09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d9ae1001-5a75-49bf-89f5-924459ef8dfd tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Creating offline snapshot d7f5dc45-0eae-4a46-b854-59d190f19545 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43dbe59-cc3d-4a6b-b5c7-84cb5c96820b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:33 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:33 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-ae88aa10-57c4-4301-9438-bfa03458bee6-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "cinder-ae88aa10-57c4-4301-9438-bfa03458bee6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-ae88aa10-57c4-4301-9438-bfa03458bee6" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-ae88aa10-57c4-4301-9438-bfa03458bee6" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee5429-8c8b-441b-a8f1-834e783d2175]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:33 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.474s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:33 devstack sudo[95610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6
Sep 09 13:18:33 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:33 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 1G
Sep 09 13:18:33 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:34 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6" returned: 0 in 0.404s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:34 devstack sudo[95624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6
Sep 09 13:18:34 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:34 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 1G" returned: 0 in 0.538s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:34 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545
Sep 09 13:18:34 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:34 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae88aa10-57c4-4301-9438-bfa03458bee6" returned: 0 in 0.366s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-ae88aa10-57c4-4301-9438-bfa03458bee6" released by "delete_volume" :: held 0.844s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=114,cinder:UPDATE=169,cinder:INSERT=45,cinder:DELETE=12 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=146,cinder:SELECT=129,cinder:DELETE=16,cinder:INSERT=38 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Created reservations ['4ee05284-4a67-4049-8970-f246e89b21c5', 'de64561e-c9a3-4f3f-a485-a79876a4d2f7', '9d5f9d3f-6b79-479e-9f37-b092974d1411', 'bbf64832-683a-4391-bafa-eab050e0cedc'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:34 devstack sudo[95634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:34 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:34 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545" returned: 0 in 0.483s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:34 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 is being set with open permissions: ugo+rw
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:34 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545
Sep 09 13:18:34 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-29e56807-2a8f-47db-b31d-c1092a85233c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "cinder-29e56807-2a8f-47db-b31d-c1092a85233c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-29e56807-2a8f-47db-b31d-c1092a85233c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-29e56807-2a8f-47db-b31d-c1092a85233c" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[feca811a-ac49-4884-b5a8-b20a143bed79]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:35 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:35 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.458s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545" returned: 0 in 0.359s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1ece167-9735-48ad-a5ee-995831ef6102 tempest-VolumesGetTest-377149646 None] Lock "cinder-ae88aa10-57c4-4301-9438-bfa03458bee6-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-634b4713-9283-407c-b3f0-d981f2c45ed9 tempest-SnapshotsActionsTest-1830497914 None] Create snapshot completed successfully
Sep 09 13:18:35 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c
Sep 09 13:18:35 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:35 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c" returned: 0 in 0.490s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:35 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c
Sep 09 13:18:35 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:35 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-29e56807-2a8f-47db-b31d-c1092a85233c" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-29e56807-2a8f-47db-b31d-c1092a85233c" released by "delete_volume" :: held 0.860s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Created reservations ['af94f4d1-5f79-427b-8f3b-922e2f885d5e', '832bb8a1-0476-45ee-88cb-67c97ce12df4', '58c75880-65b7-45bb-821a-5d78ec5edea6', '7ed3b785-0492-4f53-9530-fcbabf0f8aec'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:36 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:36 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:36 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-d7f5dc45-0eae-4a46-b854-59d190f19545-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-d7f5dc45-0eae-4a46-b854-59d190f19545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d321c22-f390-41aa-8647-0c46338aea12 tempest-VolumesGetTest-377149646 None] Lock "cinder-29e56807-2a8f-47db-b31d-c1092a85233c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-d7f5dc45-0eae-4a46-b854-59d190f19545" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-d7f5dc45-0eae-4a46-b854-59d190f19545" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Deleting offline snapshot d7f5dc45-0eae-4a46-b854-59d190f19545 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] snapshot_file for this snap is: volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed5d33-6c89-46c3-9d31-65503cff25d1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:36 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545
Sep 09 13:18:36 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (4be97072-1d36-4dd7-a1c8-e2259523150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ef40b2-7351-4da4-b8f4-3e948bc22d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ef40b2-7351-4da4-b8f4-3e948bc22d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1857719401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deaac51-b3b7-4b3f-ad53-2d385bd720cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:37Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43650abb-a7b6-4652-bf46-1ac2309259f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43650abb-a7b6-4652-bf46-1ac2309259f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8a60dd-3250-4851-a4a5-d0d45f04194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8a60dd-3250-4851-a4a5-d0d45f04194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'volume_name': 'volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26215b5-e808-4e06-a85a-2b43bbc34307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26215b5-e808-4e06-a85a-2b43bbc34307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b06c0c-a141-4803-b347-37a215d22fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:37 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Volume 0deaac51-b3b7-4b3f-ad53-2d385bd720cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'volume_size': 1}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1857719401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deaac51-b3b7-4b3f-ad53-2d385bd720cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:37Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Creating volume 0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:37 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:37 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd 1073741824
Sep 09 13:18:37 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:37 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545" returned: 0 in 0.546s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d554529-9412-4861-bf62-dcc354f6c685]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:37 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:37 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:37 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd 1073741824" returned: 0 in 0.570s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:37 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.469s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:37 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545
Sep 09 13:18:37 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:37 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:18:37 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:38 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.317s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b06c0c-a141-4803-b347-37a215d22fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b6ceb-3ef6-4217-8a84-8959769b14e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Volume volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd (0deaac51-b3b7-4b3f-ad53-2d385bd720cd): created successfully
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b6ceb-3ef6-4217-8a84-8959769b14e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (4be97072-1d36-4dd7-a1c8-e2259523150a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c25434fd-cb31-42c7-acfa-fb33f1dbe7a0 tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:18:38 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545" returned: 0 in 0.470s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:38 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545
Sep 09 13:18:38 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:38 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.d7f5dc45-0eae-4a46-b854-59d190f19545" returned: 0 in 0.268s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-d7f5dc45-0eae-4a46-b854-59d190f19545" released by "_delete_snapshot" :: held 1.903s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_snapshot" :: held 1.933s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Created reservations ['3b375513-72d4-4fdf-b637-ad44ea68c8f5', '6a739f74-9a98-4834-90f5-4782e80b879e', 'ba82258c-bb2f-4b4e-a924-9db1caaa019e', 'ca5d9ccb-f6dd-4099-8d7e-3c899815d7fc'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Delete snapshot completed successfully.
Sep 09 13:18:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2ebbbf44-1359-45e4-b6ad-2952d2730ea8 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-d7f5dc45-0eae-4a46-b854-59d190f19545-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:39 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (51bf7ab0-e1b4-49fd-b1b2-a9859c8db29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7286a6-17f1-4cbb-bc79-25e27e01915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7286a6-17f1-4cbb-bc79-25e27e01915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1507665594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0deaac51-b3b7-4b3f-ad53-2d385bd720cd,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:40Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baba9f1-ace2-441b-a423-0032c383595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baba9f1-ace2-441b-a423-0032c383595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c415140-7517-46da-8c6c-be6af78d136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c415140-7517-46da-8c6c-be6af78d136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029', 'volume_name': 'volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029', 'volume_size': 1, 'source_volid': '0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'source_volstatus': 'available'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a926e0f-3750-4a58-b21c-5f12e9103fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a926e0f-3750-4a58-b21c-5f12e9103fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df512eb-cdd4-4444-9aae-9c57a0eab6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:40 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Volume cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029', 'volume_size': 1, 'source_volid': '0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'source_volstatus': 'available'}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:40 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Cloning volume 0deaac51-b3b7-4b3f-ad53-2d385bd720cd to volume cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Creating offline snapshot de7aee27-e25f-4990-bc17-81bf19042b18 of volume 0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[499ebb6d-8446-468d-aacd-89d4aff63903]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:40 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:18:40 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:40 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.498s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:40 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 1G
Sep 09 13:18:40 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (db78e87c-d012-46bd-b50a-4ffe307ee4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00edc10-9ac4-4ccc-b2b5-5d80861d4d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00edc10-9ac4-4ccc-b2b5-5d80861d4d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-75257310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4032dd-d86d-45b9-ba92-173486b860a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:41Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3099f6f1-8706-4394-b035-34f3ef228e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3099f6f1-8706-4394-b035-34f3ef228e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3751c9-6f75-4df4-a383-58814489949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3751c9-6f75-4df4-a383-58814489949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4032dd-d86d-45b9-ba92-173486b860a7', 'volume_name': 'volume-2c4032dd-d86d-45b9-ba92-173486b860a7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249b36e3-33b4-4f93-b28b-040e19a97213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249b36e3-33b4-4f93-b28b-040e19a97213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe18e98-7ffa-42a4-9b97-e23263a87952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Volume 2c4032dd-d86d-45b9-ba92-173486b860a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4032dd-d86d-45b9-ba92-173486b860a7', 'volume_size': 1}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:41 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 1G" returned: 0 in 0.450s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:41 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:41 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:41 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.306s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:41 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 is being set with open permissions: ugo+rw
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:41 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:41 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:41 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.238s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:41 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info
Sep 09 13:18:41 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:42 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:42 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info is being set with open permissions: ugo+rw
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:42 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info
Sep 09 13:18:42 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:42 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.info" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] snapshot: de7aee27-e25f-4990-bc17-81bf19042b18, volume: cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5b2b2-e8bb-4631-a7b8-23a957513574]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:42 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:42 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:42 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.386s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0b214-e826-4da2-954e-e76be81e4009]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:42 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:18:42 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:43 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.374s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:18:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:18:43 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:18:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:43 devstack sudo[95722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029
Sep 09 13:18:43 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:48 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" returned: 0 in 5.148s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:18:48 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Converted 1024.00 MB image at 198.86 MB/s
Sep 09 13:18:48 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 is being set with open permissions: ugo+rw
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:48 devstack sudo[95737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029
Sep 09 13:18:48 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:48 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" released by "_copy_volume_from_snapshot" :: held 6.285s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-de7aee27-e25f-4990-bc17-81bf19042b18" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-de7aee27-e25f-4990-bc17-81bf19042b18" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Deleting offline snapshot de7aee27-e25f-4990-bc17-81bf19042b18 of volume 0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] snapshot_file for this snap is: volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec44f0-a527-4823-b6f7-e8dd7e2fcacd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:48 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:48 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:49 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67e5c3-57e5-41c0-bdd1-31de0e68cf7f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:49 devstack sudo[95748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:18:49 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:49 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:49 devstack sudo[95753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:49 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:50 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.369s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:50 devstack sudo[95759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18
Sep 09 13:18:50 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:50 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd.de7aee27-e25f-4990-bc17-81bf19042b18" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-de7aee27-e25f-4990-bc17-81bf19042b18" released by "_delete_snapshot" :: held 1.666s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.280s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.028s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Creating offline snapshot cf098979-69e1-454f-b9a6-41b5706012e5 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df512eb-cdd4-4444-9aae-9c57a0eab6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029', 'volume_size': 1, 'source_volid': '0deaac51-b3b7-4b3f-ad53-2d385bd720cd', 'source_volstatus': 'available'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085b48ce-71b9-4569-8d9c-dab20521e2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[295dc64d-e2d3-47ae-8a7d-45e1f6b46139]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:50 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Volume volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 (cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029): created successfully
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085b48ce-71b9-4569-8d9c-dab20521e2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (51bf7ab0-e1b4-49fd-b1b2-a9859c8db29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b94a39b4-8230-4f4f-9b19-93eea45913ab tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:18:50 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:50 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:50 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.525s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:50 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 1G
Sep 09 13:18:50 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:51 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 1G" returned: 0 in 0.536s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:51 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5
Sep 09 13:18:51 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (5453f9e2-4a5f-43e4-a617-f23317fe55da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9004fd3-7c65-434e-b742-122355554941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9004fd3-7c65-434e-b742-122355554941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-624505183',display_name='tempest-VolumesGetTest-Volume-1401089366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae104801-0f08-4da4-9c7a-affce8330bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:52Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af4460-6723-4fb7-b7d8-610c2a61a775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af4460-6723-4fb7-b7d8-610c2a61a775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43ec14-2bef-40b8-9f86-53dd69c82dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb43ec14-2bef-40b8-9f86-53dd69c82dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae104801-0f08-4da4-9c7a-affce8330bf9', 'volume_name': 'volume-ae104801-0f08-4da4-9c7a-affce8330bf9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01196a2a-809a-48ce-b694-f5d44af88d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01196a2a-809a-48ce-b694-f5d44af88d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a5e07-115b-4422-996a-67a7b957cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:51 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Volume ae104801-0f08-4da4-9c7a-affce8330bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae104801-0f08-4da4-9c7a-affce8330bf9', 'volume_size': 1}
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:51 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:51 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 is being set with open permissions: ugo+rw
Sep 09 13:18:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:51 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5
Sep 09 13:18:51 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:52 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.214s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-75257310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4032dd-d86d-45b9-ba92-173486b860a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:41Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Creating volume 2c4032dd-d86d-45b9-ba92-173486b860a7 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:52 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:52 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 1073741824
Sep 09 13:18:52 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-28231e9a-5559-402a-8a74-0f6c1b7ac107 tempest-SnapshotsActionsTest-1830497914 None] Create snapshot completed successfully
Sep 09 13:18:52 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 1073741824" returned: 0 in 0.551s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:52 devstack sudo[95789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7
Sep 09 13:18:52 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:53 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-624505183',display_name='tempest-VolumesGetTest-Volume-1401089366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae104801-0f08-4da4-9c7a-affce8330bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:52Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Creating volume ae104801-0f08-4da4-9c7a-affce8330bf9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:53 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe18e98-7ffa-42a4-9b97-e23263a87952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4032dd-d86d-45b9-ba92-173486b860a7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45da98cb-a9ad-4c6e-b0ea-ea42b9d7662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:53 devstack sudo[95792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 1073741824
Sep 09 13:18:53 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-cf098979-69e1-454f-b9a6-41b5706012e5-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-cf098979-69e1-454f-b9a6-41b5706012e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:53 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Volume volume-2c4032dd-d86d-45b9-ba92-173486b860a7 (2c4032dd-d86d-45b9-ba92-173486b860a7): created successfully
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45da98cb-a9ad-4c6e-b0ea-ea42b9d7662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (db78e87c-d012-46bd-b50a-4ffe307ee4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0e8deabf-74c3-438d-ac80-fe1c7b54afca tempest-VolumesListAdminTestJSON-823495253 None] Created volume successfully.
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-cf098979-69e1-454f-b9a6-41b5706012e5" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-cf098979-69e1-454f-b9a6-41b5706012e5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Deleting offline snapshot cf098979-69e1-454f-b9a6-41b5706012e5 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] snapshot_file for this snap is: volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a576b-8fa6-4188-b4fe-9cf9768640cd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:53 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5
Sep 09 13:18:53 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:53 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 1073741824" returned: 0 in 0.526s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:53 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[09456e0d-e864-43bf-915e-2f97cf9eeb71]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:53 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9
Sep 09 13:18:53 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:53 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:53 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:54 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a5e07-115b-4422-996a-67a7b957cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae104801-0f08-4da4-9c7a-affce8330bf9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cce103-5b26-49a3-8e3e-2e831e455167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Volume volume-ae104801-0f08-4da4-9c7a-affce8330bf9 (ae104801-0f08-4da4-9c7a-affce8330bf9): created successfully
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cce103-5b26-49a3-8e3e-2e831e455167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (5453f9e2-4a5f-43e4-a617-f23317fe55da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f8fceabf-a752-46d5-94b8-fcd7c82145da tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:18:54 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.434s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:54 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5
Sep 09 13:18:54 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:54 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5" returned: 0 in 0.544s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:54 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5
Sep 09 13:18:54 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (d94b3eca-effc-47a8-9dd9-f01d329dfe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4107cd-9d1e-4130-978d-455ffe0de109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4107cd-9d1e-4130-978d-455ffe0de109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1305938082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccee575-33a4-4111-b10c-c5df250c01f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:55Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cfff84-781b-481c-8f55-1419bbb54c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cfff84-781b-481c-8f55-1419bbb54c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbbf1b8-f55b-4502-919b-5392ee46d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbbf1b8-f55b-4502-919b-5392ee46d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccee575-33a4-4111-b10c-c5df250c01f8', 'volume_name': 'volume-5ccee575-33a4-4111-b10c-c5df250c01f8', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c71a0-cf5f-4944-a02e-ea893d50f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c71a0-cf5f-4944-a02e-ea893d50f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c402c3d-68f9-4234-98b3-3b196389f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Volume 5ccee575-33a4-4111-b10c-c5df250c01f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccee575-33a4-4111-b10c-c5df250c01f8', 'volume_size': 1}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1305938082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccee575-33a4-4111-b10c-c5df250c01f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:55Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Creating volume 5ccee575-33a4-4111-b10c-c5df250c01f8 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:54 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-ae104801-0f08-4da4-9c7a-affce8330bf9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:55 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 1073741824
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "cinder-ae104801-0f08-4da4-9c7a-affce8330bf9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:55 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-ae104801-0f08-4da4-9c7a-affce8330bf9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-ae104801-0f08-4da4-9c7a-affce8330bf9" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7142bb-622f-4a17-a7c7-ccc7d066abb9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:55 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.cf098979-69e1-454f-b9a6-41b5706012e5" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-cf098979-69e1-454f-b9a6-41b5706012e5" released by "_delete_snapshot" :: held 1.887s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_snapshot" :: held 1.919s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:55 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9
Sep 09 13:18:55 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Created reservations ['503b228d-f917-4113-87cf-46c49275127b', '662c1e56-bad4-4362-a1c2-02bb22fc8a54', '0c74bf07-d383-4c9c-9bc4-98063d03d4bc', 'e03360a9-e878-47a6-9130-20a78f37bfd3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Delete snapshot completed successfully.
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a48bf681-c6b3-47eb-9aec-5ca23159dbeb tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-cf098979-69e1-454f-b9a6-41b5706012e5-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:55 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 1073741824" returned: 0 in 0.603s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:55 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9" returned: 0 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:55 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9
Sep 09 13:18:55 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:55 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8
Sep 09 13:18:55 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:55 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ae104801-0f08-4da4-9c7a-affce8330bf9" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-ae104801-0f08-4da4-9c7a-affce8330bf9" released by "delete_volume" :: held 0.869s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:55 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8" returned: 0 in 0.338s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.103s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c402c3d-68f9-4234-98b3-3b196389f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccee575-33a4-4111-b10c-c5df250c01f8', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c8d84b-4252-4115-9a25-10ec9939ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Volume volume-5ccee575-33a4-4111-b10c-c5df250c01f8 (5ccee575-33a4-4111-b10c-c5df250c01f8): created successfully
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c8d84b-4252-4115-9a25-10ec9939ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (d94b3eca-effc-47a8-9dd9-f01d329dfe4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Creating offline snapshot 6492a7f8-74c3-48c6-bb1e-99a22616767a of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Created reservations ['e27c6752-1363-490c-b460-220d4423f543', '78a3fe75-34c0-4e33-ba1a-f5c62c096127', '7f480f59-628f-4107-aa54-3eb4012fe223', 'f2b16a09-5872-42e0-8fae-78bd0efff2b5'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78405f9-4ebd-4dd7-aa92-c3e76d7a216e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f3780617-3c46-42de-b17f-33c7dac8455f tempest-VolumesListAdminTestJSON-823495253 None] Created volume successfully.
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:56 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:56 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:56 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:18:56 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:56 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64a4ffaf-ded6-425b-8bc7-8c3000009c26 tempest-VolumesGetTest-377149646 None] Lock "cinder-ae104801-0f08-4da4-9c7a-affce8330bf9-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:56 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.408s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:56 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a 1G
Sep 09 13:18:56 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:57 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a 1G" returned: 0 in 0.599s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:57 devstack sudo[95854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a
Sep 09 13:18:57 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "cinder-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566fbb4-5237-42d7-9220-ca004d3dfad8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:18:57 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (e08b8225-a3a9-42f7-b84f-1f797b4fc926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11903f71-2500-4da9-974f-f3b238090750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:57 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029
Sep 09 13:18:57 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a" returned: 0 in 0.499s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:57 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a is being set with open permissions: ugo+rw
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11903f71-2500-4da9-974f-f3b238090750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1938766752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6816aa7-042b-4935-a1b7-5db7ac56c292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:58Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:57 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a
Sep 09 13:18:57 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0d1bcc-8134-421a-bc36-af4fe20b7680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0d1bcc-8134-421a-bc36-af4fe20b7680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7ff0c2-f101-47f3-b547-74c34ca2d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7ff0c2-f101-47f3-b547-74c34ca2d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6816aa7-042b-4935-a1b7-5db7ac56c292', 'volume_name': 'volume-a6816aa7-042b-4935-a1b7-5db7ac56c292', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a664c7-3ee4-439d-b617-78db863a1315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a664c7-3ee4-439d-b617-78db863a1315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7898e49-4e2f-49db-a5e0-16841c64b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Volume a6816aa7-042b-4935-a1b7-5db7ac56c292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6816aa7-042b-4935-a1b7-5db7ac56c292', 'volume_size': 1}
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:57 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1938766752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6816aa7-042b-4935-a1b7-5db7ac56c292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75790760f35946368922206abb312506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:18:58Z,use_quota=True,user_id='a1b8dfbff7094ac99f180e46fb3d25f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Creating volume a6816aa7-042b-4935-a1b7-5db7ac56c292 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:18:58 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:58 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" returned: 0 in 0.522s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:58 devstack sudo[95868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 1073741824
Sep 09 13:18:58 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ddd72099-df10-4566-a69a-0a60673810cd tempest-SnapshotsActionsTest-1830497914 None] Create snapshot completed successfully
Sep 09 13:18:58 devstack sudo[95869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029
Sep 09 13:18:58 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:58 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029" released by "delete_volume" :: held 0.901s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Created reservations ['144a4700-1c48-40ef-95f6-d89bb6a700cf', 'b2a14883-a666-47cf-8926-d29aa0c6c086', 'b62c78f6-f0f9-4612-a100-9da6539865c0', 'c6c41e88-6668-4e7d-83aa-db186305dd83'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:58 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:18:58 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:58 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 1073741824" returned: 0 in 0.662s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:58 devstack sudo[95881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292
Sep 09 13:18:58 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:59 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:18:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-dd56193b-e432-4589-8480-d329c67349e7 tempest-VolumesGetTest-377149646 None] Lock "cinder-cc0a5ff0-14c3-41cf-abe9-03bb4d8ad029-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:18:59 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7898e49-4e2f-49db-a5e0-16841c64b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6816aa7-042b-4935-a1b7-5db7ac56c292', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a49ae21-a04c-4d1c-a3d0-cbba02e860e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:18:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Volume volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 (a6816aa7-042b-4935-a1b7-5db7ac56c292): created successfully
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a49ae21-a04c-4d1c-a3d0-cbba02e860e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Flow 'volume_create_manager' (e08b8225-a3a9-42f7-b84f-1f797b4fc926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:18:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2c9ec40a-1d77-4d14-a2fa-31cec096549e tempest-VolumesListAdminTestJSON-823495253 None] Created volume successfully.
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-6492a7f8-74c3-48c6-bb1e-99a22616767a-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-6492a7f8-74c3-48c6-bb1e-99a22616767a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-6492a7f8-74c3-48c6-bb1e-99a22616767a" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-6492a7f8-74c3-48c6-bb1e-99a22616767a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Deleting offline snapshot 6492a7f8-74c3-48c6-bb1e-99a22616767a of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] snapshot_file for this snap is: volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c654dcc-79c2-40b7-acc6-7fbb2a7ab096]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:18:59 devstack sudo[95896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a
Sep 09 13:18:59 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-0deaac51-b3b7-4b3f-ad53-2d385bd720cd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "cinder-0deaac51-b3b7-4b3f-ad53-2d385bd720cd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:18:59 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a" returned: 0 in 0.612s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f188e-e923-4ad2-9780-e8bc3319ca04]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:18:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e49da-185f-4de4-a893-dbfbd9c39a63]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:00 devstack sudo[95904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:19:00 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:00 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:00 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:00 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.424s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:00 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd
Sep 09 13:19:00 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:00 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.509s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:00 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a
Sep 09 13:19:00 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:00 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" returned: 0 in 0.431s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-0deaac51-b3b7-4b3f-ad53-2d385bd720cd" released by "delete_volume" :: held 0.968s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Flow 'volume_create_manager' (f73bc9d1-ee78-4fba-a839-fcbd5e7b27dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d64a5-775c-48c9-9f13-83d053fff4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d64a5-775c-48c9-9f13-83d053fff4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffa599f-c56e-467a-a3f9-9d26d73926a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bb1225aa7492ebc47f6052cb594ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:01Z,use_quota=True,user_id='7efe2ebc5ce74baeb8b240442e5c38ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3036dee3-55d5-4de8-b66d-abb2b1580c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3036dee3-55d5-4de8-b66d-abb2b1580c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5e10ab-cafc-4c1e-b549-0eda8ba12898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5e10ab-cafc-4c1e-b549-0eda8ba12898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffa599f-c56e-467a-a3f9-9d26d73926a0', 'volume_name': 'volume-fffa599f-c56e-467a-a3f9-9d26d73926a0', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740128ee-11e6-48b2-9b4d-089a39c63c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740128ee-11e6-48b2-9b4d-089a39c63c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a3ee96-4602-4cf4-8551-283ec0a8f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:01 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Volume fffa599f-c56e-467a-a3f9-9d26d73926a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffa599f-c56e-467a-a3f9-9d26d73926a0', 'volume_size': 1}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffa599f-c56e-467a-a3f9-9d26d73926a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bb1225aa7492ebc47f6052cb594ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:01Z,use_quota=True,user_id='7efe2ebc5ce74baeb8b240442e5c38ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Creating volume fffa599f-c56e-467a-a3f9-9d26d73926a0 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:01 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:01 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 1073741824
Sep 09 13:19:01 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:01 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a" returned: 0 in 0.575s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Created reservations ['cc41e4b4-4f07-4273-8f32-3468a74a9f38', '5b771f8d-abb7-468c-811d-1bafb27f5b90', '0f9a7beb-6e56-49b6-a257-a5a3330ae320', '75ca8434-7946-44bb-8ec4-1ee255a0bc60'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:01 devstack sudo[95926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a
Sep 09 13:19:01 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:01 devstack sudo[95928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:01 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:01 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.6492a7f8-74c3-48c6-bb1e-99a22616767a" returned: 0 in 0.338s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-6492a7f8-74c3-48c6-bb1e-99a22616767a" released by "_delete_snapshot" :: held 2.170s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_snapshot" :: held 2.206s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:01 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Created reservations ['14920ed7-fe56-4948-a7db-e78b2d435f49', 'c6475d73-db16-4589-8e51-a5c994f811f0', '6f18b478-3eef-410d-8cb6-6fcc29ced42c', '1a0570c4-869d-49ba-a429-3d98df20e5a8'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-20828705-b131-4417-b4c1-196216e818ac tempest-VolumesGetTest-377149646 None] Lock "cinder-0deaac51-b3b7-4b3f-ad53-2d385bd720cd-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:01 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 1073741824" returned: 0 in 0.560s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Delete snapshot completed successfully.
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-775aae45-d9fb-41c1-b5bc-692ac8e3fe82 tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-6492a7f8-74c3-48c6-bb1e-99a22616767a-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:01 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0
Sep 09 13:19:01 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:01 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a3ee96-4602-4cf4-8551-283ec0a8f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffa599f-c56e-467a-a3f9-9d26d73926a0', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470c3262-b445-44cb-8ba3-9800be27e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:02 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Volume volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 (fffa599f-c56e-467a-a3f9-9d26d73926a0): created successfully
Sep 09 13:19:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470c3262-b445-44cb-8ba3-9800be27e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Flow 'volume_create_manager' (f73bc9d1-ee78-4fba-a839-fcbd5e7b27dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c6107ea5-4af1-460c-ab19-1c9274c8ec42 tempest-VolumesListAdminTestJSON-189966327 None] Created volume successfully.
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Creating offline snapshot 207ad4d6-30ce-44d6-a521-12c6816dbbfb of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a009561c-6e18-4052-8486-dd10dee91ed9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Acquiring lock "cinder-fffa599f-c56e-467a-a3f9-9d26d73926a0-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "cinder-fffa599f-c56e-467a-a3f9-9d26d73926a0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Acquiring lock "cinder-quobyte-fffa599f-c56e-467a-a3f9-9d26d73926a0" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "cinder-quobyte-fffa599f-c56e-467a-a3f9-9d26d73926a0" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:03 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:03 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee7632c-a6eb-4245-b42f-000ee8c4557a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (207bcd37-b88a-4753-95b4-b5d8b268d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eace53-d962-4c82-9c05-e6732b955a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-a6816aa7-042b-4935-a1b7-5db7ac56c292-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eace53-d962-4c82-9c05-e6732b955a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1369442626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2278a61-552c-459c-96c8-f58d9e849bd0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:04Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8151a9e9-65cb-4525-8a19-4f2192035c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8151a9e9-65cb-4525-8a19-4f2192035c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d33627-eca8-4a15-9576-7cdb0fa4ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:19:03 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0
Sep 09 13:19:03 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-a6816aa7-042b-4935-a1b7-5db7ac56c292-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-quobyte-a6816aa7-042b-4935-a1b7-5db7ac56c292" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-a6816aa7-042b-4935-a1b7-5db7ac56c292" acquired by "delete_volume" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:04 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35c6d2-6567-4604-b137-22c3f8236d71]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.780s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:04 devstack sudo[96016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb 1G
Sep 09 13:19:04 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:04 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292
Sep 09 13:19:04 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:04 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0" returned: 0 in 0.995s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:04 devstack sudo[96027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0
Sep 09 13:19:04 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:04 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292" returned: 0 in 0.712s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:04 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292
Sep 09 13:19:04 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d33627-eca8-4a15-9576-7cdb0fa4ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2278a61-552c-459c-96c8-f58d9e849bd0', 'volume_name': 'volume-a2278a61-552c-459c-96c8-f58d9e849bd0', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54681d2b0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348e9e00-c73c-4a69-986d-bf4fe37a5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348e9e00-c73c-4a69-986d-bf4fe37a5dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798383c0-01eb-4267-8355-28b9b95c186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:04 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Volume a2278a61-552c-459c-96c8-f58d9e849bd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2278a61-552c-459c-96c8-f58d9e849bd0', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54681d2b0>}
Sep 09 13:19:04 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Trying to clone a2278a61-552c-459c-96c8-f58d9e849bd0 from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:19:05 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb 1G" returned: 0 in 0.898s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:05 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb
Sep 09 13:19:05 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:05 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-fffa599f-c56e-467a-a3f9-9d26d73926a0" returned: 0 in 0.567s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "cinder-quobyte-fffa599f-c56e-467a-a3f9-9d26d73926a0" released by "delete_volume" :: held 1.695s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Created reservations ['4f8c53ae-f3e8-49e3-9cea-9af20cf70ae2', 'ed714da9-fcb5-4a54-983a-0dc39cf71196', '68fda95a-1fbb-4cc8-af60-b59ad177b8a7', 'ac020509-0f65-48e6-bd24-ab84ad391d14'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:05 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a6816aa7-042b-4935-a1b7-5db7ac56c292" returned: 0 in 0.709s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:19:05 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-a6816aa7-042b-4935-a1b7-5db7ac56c292" released by "delete_volume" :: held 1.609s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:05 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:05 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:05 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb" returned: 0 in 0.742s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[50820eb0-44d3-44da-8fd3-db43eb7ae1e3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:05 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb is being set with open permissions: ugo+rw
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:05 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb
Sep 09 13:19:05 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Created reservations ['73abcfb7-0d18-4ac4-8230-593b908342cf', '6947e7b9-6b80-4e22-9009-0f6f0543d3c9', 'd49dd6d0-a976-412e-818b-8d4ec4f30392', '5515fa8f-ef7e-4b5f-bca9-56f9d77f93cc'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:06 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD
Sep 09 13:19:06 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:06 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:06 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:06 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.461s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Deleted volume successfully.
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-868c331a-708c-4c75-8739-55619b788a7d tempest-VolumesListAdminTestJSON-189966327 None] Lock "cinder-fffa599f-c56e-467a-a3f9-9d26d73926a0-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:06 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-5ccee575-33a4-4111-b10c-c5df250c01f8-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 is fetched for user 97a40acda02e4b77b4bd4496985e601a. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-5ccee575-33a4-4111-b10c-c5df250c01f8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:06 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-quobyte-5ccee575-33a4-4111-b10c-c5df250c01f8" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb" returned: 0 in 0.795s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:06 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-5ccee575-33a4-4111-b10c-c5df250c01f8" acquired by "delete_volume" :: waited 0.089s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.642s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60df1a3-d9de-45bd-b35f-087ec6aa47c3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Deleted volume successfully.
Sep 09 13:19:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-885c37fe-4bb0-453c-890f-9285723ccc3c tempest-SnapshotsActionsTest-1830497914 None] Create snapshot completed successfully
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d38382-58f4-4d99-a7eb-fc23c8a7098e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bef3caba-3f26-4f89-9f84-0ececf4719f9 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-a6816aa7-042b-4935-a1b7-5db7ac56c292-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:06 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD
Sep 09 13:19:06 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:06 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8
Sep 09 13:19:06 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:07 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1369442626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2278a61-552c-459c-96c8-f58d9e849bd0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:04Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Creating volume a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:07 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:07 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8" returned: 0 in 0.592s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:07 devstack sudo[96066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1073741824
Sep 09 13:19:07 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:07 devstack sudo[96067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8
Sep 09 13:19:07 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:07 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5ccee575-33a4-4111-b10c-c5df250c01f8" returned: 0 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-5ccee575-33a4-4111-b10c-c5df250c01f8" released by "delete_volume" :: held 1.008s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Created reservations ['f7a28670-84f2-42d5-bdb6-c4fd6ee9a68d', '701061d1-3909-4b22-b839-acc427e88f0c', '62c74341-dd91-4e7f-ace3-fc27fef3c27e', '099df6a2-6807-47fe-945b-85ee3cd37c72'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-207ad4d6-30ce-44d6-a521-12c6816dbbfb-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-207ad4d6-30ce-44d6-a521-12c6816dbbfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Acquiring lock "cinder-quobyte-207ad4d6-30ce-44d6-a521-12c6816dbbfb" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-207ad4d6-30ce-44d6-a521-12c6816dbbfb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Deleting offline snapshot 207ad4d6-30ce-44d6-a521-12c6816dbbfb of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] snapshot_file for this snap is: volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7da86-1371-4179-8e9e-f0168e232ccf]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:08 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1073741824" returned: 0 in 0.812s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:08 devstack sudo[96077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:08 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:08 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb
Sep 09 13:19:08 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:08 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0
Sep 09 13:19:08 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:08 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.446s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:08 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb" returned: 0 in 0.505s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:08 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Deleted volume successfully.
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a03fb0-abcd-44ea-a4ee-cd4b11113f4b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-77429a2c-d828-40b2-be2d-881052e46bd1 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-5ccee575-33a4-4111-b10c-c5df250c01f8-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Attempting download of 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume a2278a61-552c-459c-96c8-f58d9e849bd0. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e2509-4eb8-49a5-b84c-6e0d6356f2c2]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:08 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:08 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:08 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd
Sep 09 13:19:08 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-2c4032dd-d86d-45b9-ba92-173486b860a7-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-2c4032dd-d86d-45b9-ba92-173486b860a7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "cinder-quobyte-2c4032dd-d86d-45b9-ba92-173486b860a7" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-2c4032dd-d86d-45b9-ba92-173486b860a7" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97cbd2-14bf-4957-b6bf-a3fe9c696a79]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.559s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb
Sep 09 13:19:09 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7
Sep 09 13:19:09 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd" returned: 0 in 0.511s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd
Sep 09 13:19:09 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7" returned: 0 in 0.426s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7
Sep 09 13:19:09 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb" returned: 0 in 0.438s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd" returned: 1 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_mf59a6rd' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7a1d0-b7ee-497a-a777-2c54e730992d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:09 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb
Sep 09 13:19:09 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD
Sep 09 13:19:09 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:09 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2c4032dd-d86d-45b9-ba92-173486b860a7" returned: 0 in 0.345s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-quobyte-2c4032dd-d86d-45b9-ba92-173486b860a7" released by "delete_volume" :: held 0.824s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.207ad4d6-30ce-44d6-a521-12c6816dbbfb" returned: 0 in 0.289s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-207ad4d6-30ce-44d6-a521-12c6816dbbfb" released by "_delete_snapshot" :: held 1.953s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_snapshot" :: held 1.996s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:09 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:09 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] 11a0fc37-23e8-4a61-8370-95b767ddcca5 was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:10 devstack sudo[96125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0
Sep 09 13:19:10 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Created reservations ['e0085957-d7a3-40d3-b630-c40aaa8b876f', '94c382f1-3efd-4cb4-8972-ed1a48518071', 'faf7077c-6434-4a37-aeb4-67dba54aa807', '07e5d2c1-6469-4b94-92ca-4812c4c63f32'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Created reservations ['dc486b6c-69ec-48fe-aa48-6d84283c99e1', '787a3476-5181-45e1-ab89-30b6947c9ebb', '9bd2692f-700f-4912-8755-510ab2d86687', '93b285d9-f31b-4c9b-9f2f-0c87a97e3385'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:10 devstack sudo[96127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Delete snapshot completed successfully.
Sep 09 13:19:10 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-90a17987-ff69-4d1f-a4c4-71f15ee9299b tempest-SnapshotsActionsTest-5338992 None] Lock "cinder-207ad4d6-30ce-44d6-a521-12c6816dbbfb-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:10 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.298s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Deleted volume successfully.
Sep 09 13:19:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b0bfd6aa-fc8f-47c0-973a-0258d1128a37 tempest-VolumesListAdminTestJSON-823495253 None] Lock "cinder-2c4032dd-d86d-45b9-ba92-173486b860a7-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "cinder-a4e9a49b-774b-4b5d-96e7-4724ac30fa72-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-a4e9a49b-774b-4b5d-96e7-4724ac30fa72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "cinder-quobyte-a4e9a49b-774b-4b5d-96e7-4724ac30fa72" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-a4e9a49b-774b-4b5d-96e7-4724ac30fa72" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Deleting offline snapshot a4e9a49b-774b-4b5d-96e7-4724ac30fa72 of volume 2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] snapshot_file for this snap is: volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14ce070-020f-4d76-820a-dd14609857ff]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:12 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:12 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:12 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0" returned: 0 in 2.093s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_je_qr5mkdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:19:12 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Converted 112.00 MB image at 53.45 MB/s
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:12 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1G
Sep 09 13:19:12 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:12 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.520s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b3d7f-f17e-44bb-a522-28cb53182438]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:12 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 1G" returned: 0 in 0.404s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Downloaded image 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume a2278a61-552c-459c-96c8-f58d9e849bd0 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 for user 97a40acda02e4b77b4bd4496985e601a is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Marking volume a2278a61-552c-459c-96c8-f58d9e849bd0 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Copying metadata from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 to a2278a61-552c-459c-96c8-f58d9e849bd0. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Creating volume glance metadata for volume a2278a61-552c-459c-96c8-f58d9e849bd0 backed by image 11a0fc37-23e8-4a61-8370-95b767ddcca5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:19:12 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e
Sep 09 13:19:12 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798383c0-01eb-4267-8355-28b9b95c186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2278a61-552c-459c-96c8-f58d9e849bd0', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54681d2b0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f6581f-dc7b-4141-abee-dc143f44b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:12 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Volume volume-a2278a61-552c-459c-96c8-f58d9e849bd0 (a2278a61-552c-459c-96c8-f58d9e849bd0): created successfully
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f6581f-dc7b-4141-abee-dc143f44b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (207bcd37-b88a-4753-95b4-b5d8b268d20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-56d72d31-012b-4f2c-bbd8-397de15eca29 tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:19:12 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" returned: 0 in 0.407s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:12 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:12 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:13 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.397s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:13 devstack sudo[96161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72
Sep 09 13:19:13 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:13 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e.a4e9a49b-774b-4b5d-96e7-4724ac30fa72" returned: 0 in 0.328s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-a4e9a49b-774b-4b5d-96e7-4724ac30fa72" released by "_delete_snapshot" :: held 1.816s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_snapshot" :: held 1.872s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Created reservations ['bb18a809-70f0-422e-b1e2-a6e0625460e5', '829b9f2d-342b-488b-913e-4bdfd8faef55', '3d45f9db-153b-460f-9804-18a28e68c06b', '3ecca482-4f5a-484f-8e51-5eeeff592f67'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Delete snapshot completed successfully.
Sep 09 13:19:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9710f0c4-172b-4d81-9270-b7b6b5f071dc tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-a4e9a49b-774b-4b5d-96e7-4724ac30fa72-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "cinder-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" acquired by "delete_volume" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee04d2e6-8721-4c19-b913-5fa207496076]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:14 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e
Sep 09 13:19:14 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:14 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (2484b5f6-60ea-4842-a952-c5f09c81889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37250955-14b5-48e3-bcfa-1a171c2ab8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" returned: 0 in 0.534s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37250955-14b5-48e3-bcfa-1a171c2ab8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-427404154',display_name='tempest-VolumesGetTest-Volume-577266977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e3d67f-60ed-4375-9413-077dce23183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:15Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:14 devstack sudo[96203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e
Sep 09 13:19:14 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b07579-475d-492f-a941-4a9bd96df9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b07579-475d-492f-a941-4a9bd96df9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1709eded-339d-403d-8732-51ff25b2319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1709eded-339d-403d-8732-51ff25b2319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e3d67f-60ed-4375-9413-077dce23183d', 'volume_name': 'volume-b1e3d67f-60ed-4375-9413-077dce23183d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5922e62e-552a-4179-b80f-29730ad62819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5922e62e-552a-4179-b80f-29730ad62819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d8bf0a-5b9b-4d67-8bec-6292754fdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:14 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Volume b1e3d67f-60ed-4375-9413-077dce23183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e3d67f-60ed-4375-9413-077dce23183d', 'volume_size': 1}
Sep 09 13:19:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-427404154',display_name='tempest-VolumesGetTest-Volume-577266977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e3d67f-60ed-4375-9413-077dce23183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89fe20a604b4a7eafe99fe6788516b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:15Z,use_quota=True,user_id='97a40acda02e4b77b4bd4496985e601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Creating volume b1e3d67f-60ed-4375-9413-077dce23183d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:15 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:15 devstack sudo[96205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d 1073741824
Sep 09 13:19:15 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:15 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" returned: 0 in 0.548s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-quobyte-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e" released by "delete_volume" :: held 1.174s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Created reservations ['c615a879-fe4e-4f78-8404-99b23ce835d6', '2b123743-e6d0-4576-ba63-92ac25f656f5', '8a3e9b78-0af3-4ed7-ac07-54bf1f39bc56', 'fcedfd64-ce0f-48de-9527-c520c9059422'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:15 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d 1073741824" returned: 0 in 0.688s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:15 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:15 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:15 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d
Sep 09 13:19:15 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:15 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.286s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:15 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Deleted volume successfully.
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0bda15ba-2a0d-4e90-bf8f-c809d2c0e5f1 tempest-SnapshotsActionsTest-1830497914 None] Lock "cinder-2a6b80a8-cdc5-4fad-ade1-49d9d727db3e-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:16 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d8bf0a-5b9b-4d67-8bec-6292754fdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e3d67f-60ed-4375-9413-077dce23183d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f3be04-cf8f-4e0d-b8c7-e9f10e5c1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:16 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Volume volume-b1e3d67f-60ed-4375-9413-077dce23183d (b1e3d67f-60ed-4375-9413-077dce23183d): created successfully
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f3be04-cf8f-4e0d-b8c7-e9f10e5c1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Flow 'volume_create_manager' (2484b5f6-60ea-4842-a952-c5f09c81889b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-550b00aa-cc0f-4df9-8a02-525f8aa50c84 tempest-VolumesGetTest-377149646 None] Created volume successfully.
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-b1e3d67f-60ed-4375-9413-077dce23183d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "cinder-b1e3d67f-60ed-4375-9413-077dce23183d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-b1e3d67f-60ed-4375-9413-077dce23183d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-b1e3d67f-60ed-4375-9413-077dce23183d" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505ab42-a974-4200-90b1-472c24af2b97]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:17 devstack sudo[96242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d
Sep 09 13:19:17 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:17 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d" returned: 0 in 0.412s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:17 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d
Sep 09 13:19:17 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:17 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b1e3d67f-60ed-4375-9413-077dce23183d" returned: 0 in 0.312s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-b1e3d67f-60ed-4375-9413-077dce23183d" released by "delete_volume" :: held 0.791s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Created reservations ['d896452d-7d4b-4852-ae76-628a87050963', '58ebc0aa-15c2-4af6-bee3-5a2303d29d98', '89ac66de-ad9e-4f87-b0b2-7dc8d13add15', 'b8952cb3-2d4f-4076-bbdc-da636078e56e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:18 devstack sudo[96251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:18 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-a2278a61-552c-459c-96c8-f58d9e849bd0-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "cinder-a2278a61-552c-459c-96c8-f58d9e849bd0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Acquiring lock "cinder-quobyte-a2278a61-552c-459c-96c8-f58d9e849bd0" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-a2278a61-552c-459c-96c8-f58d9e849bd0" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556bea4-fd6f-4c47-bd1f-b40c4b3730e0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:18 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.451s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:19:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cbf24cff-416b-4bbd-ab98-90db7d2b74cc tempest-VolumesGetTest-377149646 None] Lock "cinder-b1e3d67f-60ed-4375-9413-077dce23183d-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:18 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0
Sep 09 13:19:18 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:18 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0" returned: 0 in 0.485s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:19 devstack sudo[96260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0
Sep 09 13:19:19 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:19 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a2278a61-552c-459c-96c8-f58d9e849bd0" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "cinder-quobyte-a2278a61-552c-459c-96c8-f58d9e849bd0" released by "delete_volume" :: held 0.841s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Created reservations ['f490a31b-2aaf-4d0f-9450-7f17a145879e', '72bccbd7-5ae1-4a99-b9db-66d7e46cb430', '2509112f-203f-4601-92c2-266e48dd5896', 'd3ee008a-905e-44dc-94c1-11d089f8f3f8'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:19 devstack sudo[96263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:19 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:19 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.353s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Deleted volume successfully.
Sep 09 13:19:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c6f6f1d7-d427-46d1-a780-01b141d998ca tempest-VolumesGetTest-377149646 None] Lock "cinder-a2278a61-552c-459c-96c8-f58d9e849bd0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:25 devstack sudo[96275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:25 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:25 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.311s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:19:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (6a2e4ffa-1727-4317-9a6d-9b42aa73627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232e244-943e-4d14-89b9-1a9763f2d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d232e244-943e-4d14-89b9-1a9763f2d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-697747422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0c81e5-6601-4202-a0c2-d213552d3caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:28Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6530db-d0e2-42eb-b336-894f00e290e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6530db-d0e2-42eb-b336-894f00e290e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ff1568-7ec3-4e9f-9f5d-a4121dd9c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ff1568-7ec3-4e9f-9f5d-a4121dd9c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0c81e5-6601-4202-a0c2-d213552d3caa', 'volume_name': 'volume-aa0c81e5-6601-4202-a0c2-d213552d3caa', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d61d96-2dc8-4147-b77b-baa05cb13baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d61d96-2dc8-4147-b77b-baa05cb13baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b60fb7-a719-40d6-8eb0-4f4487100fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Volume aa0c81e5-6601-4202-a0c2-d213552d3caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0c81e5-6601-4202-a0c2-d213552d3caa', 'volume_size': 1}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-697747422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0c81e5-6601-4202-a0c2-d213552d3caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:28Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Creating volume aa0c81e5-6601-4202-a0c2-d213552d3caa {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:28 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:28 devstack sudo[96280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa 1073741824
Sep 09 13:19:28 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Flow 'volume_create_manager' (85b0422f-334e-4c9f-a629-5602902d5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf7c62d-6192-47a8-87b0-50955fff3e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf7c62d-6192-47a8-87b0-50955fff3e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-727327857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be51d693-17c8-4bd9-a509-51abc4287369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af20b532d24270b2b5534346fef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:29Z,use_quota=True,user_id='7724ecd17df94fb18d4f07309b44c16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a26784-dbc6-4f7d-b43b-baff9d217424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a26784-dbc6-4f7d-b43b-baff9d217424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa034cc-daad-4e9d-b3f8-a9e1b464e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa034cc-daad-4e9d-b3f8-a9e1b464e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be51d693-17c8-4bd9-a509-51abc4287369', 'volume_name': 'volume-be51d693-17c8-4bd9-a509-51abc4287369', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f034ea-9621-4e6b-9d00-03d784fdcd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f034ea-9621-4e6b-9d00-03d784fdcd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49541911-9def-4e42-b1c7-66472779415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Volume be51d693-17c8-4bd9-a509-51abc4287369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be51d693-17c8-4bd9-a509-51abc4287369', 'volume_size': 1}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:28 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa 1073741824" returned: 0 in 0.624s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:28 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa
Sep 09 13:19:28 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:29 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-727327857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be51d693-17c8-4bd9-a509-51abc4287369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57af20b532d24270b2b5534346fef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:29Z,use_quota=True,user_id='7724ecd17df94fb18d4f07309b44c16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Creating volume be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:29 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b60fb7-a719-40d6-8eb0-4f4487100fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0c81e5-6601-4202-a0c2-d213552d3caa', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:29 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 1073741824
Sep 09 13:19:29 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00660c4e-a066-4624-8126-e6d93babf90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Volume volume-aa0c81e5-6601-4202-a0c2-d213552d3caa (aa0c81e5-6601-4202-a0c2-d213552d3caa): created successfully
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00660c4e-a066-4624-8126-e6d93babf90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (6a2e4ffa-1727-4317-9a6d-9b42aa73627b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-094d1c2b-4aad-44f4-8e3b-0f000c6ff6af tempest-AttachVolumeNegativeTest-389404715 None] Created volume successfully.
Sep 09 13:19:29 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 1073741824" returned: 0 in 0.468s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:29 devstack sudo[96296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369
Sep 09 13:19:29 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:30 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369" returned: 0 in 0.389s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49541911-9def-4e42-b1c7-66472779415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be51d693-17c8-4bd9-a509-51abc4287369', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de79d0bd-395f-4f56-8d70-6c62fd39ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Volume volume-be51d693-17c8-4bd9-a509-51abc4287369 (be51d693-17c8-4bd9-a509-51abc4287369): created successfully
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de79d0bd-395f-4f56-8d70-6c62fd39ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Flow 'volume_create_manager' (85b0422f-334e-4c9f-a629-5602902d5f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bea36e18-066b-4105-881d-6e872914fc27 tempest-SnapshotMetadataTestJSON-2065266339 None] Created volume successfully.
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Creating offline snapshot af5f9567-6e6c-4564-a5f5-2dcb429fdad6 of volume be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a692d12-31ba-45e5-8c78-59dcf902efb1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:31 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369
Sep 09 13:19:31 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-b48a8694-2b02-4384-810e-93ebc97923ea req-78cb7764-ed8d-4f75-96b2-65db52a1d6a9 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:31 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369" returned: 0 in 0.524s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:31 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 1G
Sep 09 13:19:31 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:32 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 1G" returned: 0 in 0.629s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be51d693-17c8-4bd9-a509-51abc4287369 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:32 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be51d693-17c8-4bd9-a509-51abc4287369 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6
Sep 09 13:19:32 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:32 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be51d693-17c8-4bd9-a509-51abc4287369 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:32 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 is being set with open permissions: ugo+rw
Sep 09 13:19:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:32 devstack sudo[96333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6
Sep 09 13:19:32 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:33 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6" returned: 0 in 0.330s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:33 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info
Sep 09 13:19:33 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:33 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info" returned: 0 in 0.439s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:33 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info is being set with open permissions: ugo+rw
Sep 09 13:19:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:33 devstack sudo[96339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info
Sep 09 13:19:33 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:34 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.info" returned: 0 in 0.371s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-b48a8694-2b02-4384-810e-93ebc97923ea req-78cb7764-ed8d-4f75-96b2-65db52a1d6a9 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.443s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-b48a8694-2b02-4384-810e-93ebc97923ea req-78cb7764-ed8d-4f75-96b2-65db52a1d6a9 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e8593125-7437-4240-9012-35010aa42466 tempest-SnapshotMetadataTestJSON-2065266339 None] Create snapshot completed successfully
Sep 09 13:19:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-b48a8694-2b02-4384-810e-93ebc97923ea req-78cb7764-ed8d-4f75-96b2-65db52a1d6a9 tempest-AttachVolumeNegativeTest-389404715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-aa0c81e5-6601-4202-a0c2-d213552d3caa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '460044ff-1048-45f8-ae7f-1f458fc5bc03', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:19:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-b48a8694-2b02-4384-810e-93ebc97923ea req-78cb7764-ed8d-4f75-96b2-65db52a1d6a9 tempest-AttachVolumeNegativeTest-389404715 None] attachment_update completed successfully.
Sep 09 13:19:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "cinder-af5f9567-6e6c-4564-a5f5-2dcb429fdad6-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-af5f9567-6e6c-4564-a5f5-2dcb429fdad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "cinder-quobyte-af5f9567-6e6c-4564-a5f5-2dcb429fdad6" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-af5f9567-6e6c-4564-a5f5-2dcb429fdad6" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Deleting offline snapshot af5f9567-6e6c-4564-a5f5-2dcb429fdad6 of volume be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] snapshot_file for this snap is: volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91da89-c1ab-4382-bc83-55e5c85d7ec8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:36 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6
Sep 09 13:19:36 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:36 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6" returned: 0 in 0.508s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be51d693-17c8-4bd9-a509-51abc4287369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49f79d-a9c1-4d2b-b7b2-92d844725432]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:36 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369
Sep 09 13:19:36 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:37 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369" returned: 0 in 0.685s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:37 devstack sudo[96734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6
Sep 09 13:19:37 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:37 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6" returned: 0 in 0.429s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:37 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6
Sep 09 13:19:37 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:38 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369.af5f9567-6e6c-4564-a5f5-2dcb429fdad6" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=125,cinder:INSERT=44,cinder:UPDATE=175,cinder:DELETE=15 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:INSERT=51,cinder:UPDATE=157,cinder:SELECT=144,cinder:DELETE=13 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-af5f9567-6e6c-4564-a5f5-2dcb429fdad6" released by "_delete_snapshot" :: held 2.159s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" released by "delete_snapshot" :: held 2.217s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Created reservations ['33ffc15d-9150-45c2-926b-5f2c796be9ac', 'c4472c98-edf2-4ade-982e-e88600b15a12', '7f0bb439-521f-406d-9ac6-ed64a5d7e778', '989496ff-531c-4c77-8b2f-5975700cc8cf'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Delete snapshot completed successfully.
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d68cf9ed-73ec-4e64-a212-1e6e4ecf70f4 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-af5f9567-6e6c-4564-a5f5-2dcb429fdad6-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (a3d224b1-66ef-4d08-ae91-180bca7e9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c17de68-8590-4bc1-8d64-6657c7fb82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c17de68-8590-4bc1-8d64-6657c7fb82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066441728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01673114-d016-435c-9663-560ba36c9dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:38Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86c51c0-fcc9-438e-8887-af6c09b91c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86c51c0-fcc9-438e-8887-af6c09b91c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52f2f25-81d6-4587-8522-36df04433f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52f2f25-81d6-4587-8522-36df04433f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01673114-d016-435c-9663-560ba36c9dbe', 'volume_name': 'volume-01673114-d016-435c-9663-560ba36c9dbe', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc434343-66ff-49fc-9fc1-4d62cb2e4781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc434343-66ff-49fc-9fc1-4d62cb2e4781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5395997f-e412-4aa6-ac70-5843a4ff88ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume 01673114-d016-435c-9663-560ba36c9dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01673114-d016-435c-9663-560ba36c9dbe', 'volume_size': 1}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066441728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01673114-d016-435c-9663-560ba36c9dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:38Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating volume 01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:38 devstack sudo[96743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe 1073741824
Sep 09 13:19:38 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:39 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe 1073741824" returned: 0 in 0.529s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:39 devstack sudo[96750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe
Sep 09 13:19:39 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "cinder-be51d693-17c8-4bd9-a509-51abc4287369-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-be51d693-17c8-4bd9-a509-51abc4287369-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775a849-5d0b-47f5-8007-8be569d8ffc2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:39 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe" returned: 0 in 0.393s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5395997f-e412-4aa6-ac70-5843a4ff88ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01673114-d016-435c-9663-560ba36c9dbe', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79771c49-4380-4324-bb3a-e87e32a8f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume volume-01673114-d016-435c-9663-560ba36c9dbe (01673114-d016-435c-9663-560ba36c9dbe): created successfully
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79771c49-4380-4324-bb3a-e87e32a8f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (a3d224b1-66ef-4d08-ae91-180bca7e9b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:39 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369
Sep 09 13:19:39 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1b280fc0-8f68-4b2f-8e3c-971465ad7cc5 tempest-VolumesSnapshotTestJSON-1695755086 None] Created volume successfully.
Sep 09 13:19:39 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369" returned: 0 in 0.418s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:39 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369
Sep 09 13:19:39 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:40 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be51d693-17c8-4bd9-a509-51abc4287369" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-quobyte-be51d693-17c8-4bd9-a509-51abc4287369" released by "delete_volume" :: held 0.810s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Created reservations ['0dd2b3b9-7ee4-48f0-9838-dfa3ede30006', 'b965716e-7b3a-4abd-99f2-fcb2a94dced1', '3e74eb02-7311-483e-a8cd-02c7c447b7c3', '6f309995-8117-430e-87e9-fd0e5fa4c498'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:40 devstack sudo[96765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:40 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:40 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.330s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Deleted volume successfully.
Sep 09 13:19:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c31a67f-8ed3-439e-ad91-d20d1afbba81 tempest-SnapshotMetadataTestJSON-2065266339 None] Lock "cinder-be51d693-17c8-4bd9-a509-51abc4287369-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Creating offline snapshot 036dfa39-ca69-41fe-88e2-0ad357cca181 of volume 01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:19:41 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778d4b3-177b-4113-867e-7a355961aaa7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:41 devstack sudo[96769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe
Sep 09 13:19:41 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:42 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe" returned: 0 in 0.661s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:42 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 1G
Sep 09 13:19:42 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:42 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 1G" returned: 0 in 0.682s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01673114-d016-435c-9663-560ba36c9dbe -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:42 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01673114-d016-435c-9663-560ba36c9dbe -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181
Sep 09 13:19:42 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:43 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01673114-d016-435c-9663-560ba36c9dbe -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181" returned: 0 in 0.430s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:43 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 is being set with open permissions: ugo+rw
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:43 devstack sudo[96801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181
Sep 09 13:19:43 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:43 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:43 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info
Sep 09 13:19:43 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Flow 'volume_create_manager' (2d400a3c-4ab4-4729-ac53-2fec6acd1839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f60f1f-2386-4958-9465-7cdf4d9001dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f60f1f-2386-4958-9465-7cdf4d9001dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1786776011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c53ee1-cc05-410f-bca6-2c02a99c5dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a43a0c300b4124bb3ec4a1bfc23cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:44Z,use_quota=True,user_id='797cdf53269a49e791a4758923ae1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:44 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da341e29-f643-4eeb-b580-67d9c73e1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da341e29-f643-4eeb-b580-67d9c73e1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eee71c7-706a-4404-9f2a-d5a05eeab373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eee71c7-706a-4404-9f2a-d5a05eeab373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c53ee1-cc05-410f-bca6-2c02a99c5dc1', 'volume_name': 'volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae20f1b-9be7-4e1d-bcc8-9741ab37e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae20f1b-9be7-4e1d-bcc8-9741ab37e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf94bd8-5e6d-49b9-8e21-3c856564853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:44 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume 95c53ee1-cc05-410f-bca6-2c02a99c5dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1', 'volume_size': 1}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info" returned: 0 in 0.386s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:44 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info is being set with open permissions: ugo+rw
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:44 devstack sudo[96808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info
Sep 09 13:19:44 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:44 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.info" returned: 0 in 0.336s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1786776011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c53ee1-cc05-410f-bca6-2c02a99c5dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a43a0c300b4124bb3ec4a1bfc23cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:44Z,use_quota=True,user_id='797cdf53269a49e791a4758923ae1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Creating volume 95c53ee1-cc05-410f-bca6-2c02a99c5dc1 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:44 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:44 devstack sudo[96812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 1073741824
Sep 09 13:19:44 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0dc68ad6-5860-4d7f-a760-c5031a28ef7f tempest-VolumesSnapshotTestJSON-1695755086 None] Create snapshot completed successfully
Sep 09 13:19:44 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 1073741824" returned: 0 in 0.556s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:45 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1
Sep 09 13:19:45 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:45 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" returned: 0 in 0.459s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf94bd8-5e6d-49b9-8e21-3c856564853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a84c3a-8b4a-4784-8625-ba222d15aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 (95c53ee1-cc05-410f-bca6-2c02a99c5dc1): created successfully
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a84c3a-8b4a-4784-8625-ba222d15aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Flow 'volume_create_manager' (2d400a3c-4ab4-4729-ac53-2fec6acd1839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b6306a53-f28b-41ef-a1a2-e830d214f1ac tempest-VolumeQuotasAdminTestJSON-142771278 None] Created volume successfully.
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-036dfa39-ca69-41fe-88e2-0ad357cca181-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-036dfa39-ca69-41fe-88e2-0ad357cca181-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-036dfa39-ca69-41fe-88e2-0ad357cca181" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-036dfa39-ca69-41fe-88e2-0ad357cca181" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Deleting offline snapshot 036dfa39-ca69-41fe-88e2-0ad357cca181 of volume 01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] snapshot_file for this snap is: volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a89e3-d815-42d8-bcaa-04892ece0df3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "cinder-95c53ee1-cc05-410f-bca6-2c02a99c5dc1-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:46 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181
Sep 09 13:19:46 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "cinder-95c53ee1-cc05-410f-bca6-2c02a99c5dc1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "cinder-quobyte-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "cinder-quobyte-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a303dbf-348f-46b2-99ff-b0f7aedc9c4e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Flow 'volume_create_manager' (ac4c6ed3-b277-4d1e-ba6c-ea5fa3696978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0e26b2-d911-4cf4-81cc-ee0da95e18e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0e26b2-d911-4cf4-81cc-ee0da95e18e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2018354603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19e7eef-83d6-4de5-8d2e-d60d4621ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13825317741f4c0985b7b1355672e33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:47Z,use_quota=True,user_id='8bcd6e1be2094715ba5b1d0794ac8b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528dd3ee-798d-4e2a-9624-37073d461063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528dd3ee-798d-4e2a-9624-37073d461063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198c952a-391f-4594-b4fc-edb09c223adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198c952a-391f-4594-b4fc-edb09c223adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19e7eef-83d6-4de5-8d2e-d60d4621ad09', 'volume_name': 'volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db59e00f-2757-4fd9-b4b5-0075bcbef7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db59e00f-2757-4fd9-b4b5-0075bcbef7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33abb0-7b7f-480b-ace8-3e6a5cc61830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Volume f19e7eef-83d6-4de5-8d2e-d60d4621ad09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09', 'volume_size': 1}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2018354603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19e7eef-83d6-4de5-8d2e-d60d4621ad09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13825317741f4c0985b7b1355672e33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:47Z,use_quota=True,user_id='8bcd6e1be2094715ba5b1d0794ac8b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Creating volume f19e7eef-83d6-4de5-8d2e-d60d4621ad09 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:46 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:46 devstack sudo[96864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1
Sep 09 13:19:46 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:46 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 1073741824
Sep 09 13:19:46 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:46 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181" returned: 0 in 0.603s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01673114-d016-435c-9663-560ba36c9dbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0106d-e32f-4bac-8530-194c54e84fa2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:47 devstack sudo[96873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe
Sep 09 13:19:47 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:47 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" returned: 0 in 0.762s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:47 devstack sudo[96881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1
Sep 09 13:19:47 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:47 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe" returned: 0 in 0.676s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:47 devstack sudo[96888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181
Sep 09 13:19:47 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:47 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 1073741824" returned: 0 in 0.960s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:47 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09
Sep 09 13:19:47 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:47 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" returned: 0 in 0.590s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "cinder-quobyte-95c53ee1-cc05-410f-bca6-2c02a99c5dc1" released by "delete_volume" :: held 1.414s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Created reservations ['95f964f8-7ca5-4201-ae09-5955c30de503', 'fb91525b-179b-4a14-988d-11d2556e24d6', 'c23492c7-eec2-45c3-ac5e-e3d6b5ba01d3', 'ccdc3e78-18ab-4ea1-8667-10ce1505eb6f'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:48 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181" returned: 0 in 0.569s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:48 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:48 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:48 devstack sudo[96898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181
Sep 09 13:19:48 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:48 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" returned: 0 in 0.502s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33abb0-7b7f-480b-ace8-3e6a5cc61830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4b4b60-91dc-4310-a79c-9c711e9debd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Volume volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 (f19e7eef-83d6-4de5-8d2e-d60d4621ad09): created successfully
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4b4b60-91dc-4310-a79c-9c711e9debd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Flow 'volume_create_manager' (ac4c6ed3-b277-4d1e-ba6c-ea5fa3696978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d5dc9f3d-8387-414b-a7c7-0ac4929666d1 tempest-VolumesMetadataTest-506008514 None] Created volume successfully.
Sep 09 13:19:48 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Deleted volume successfully.
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5dfd7a5c-f351-4c9f-95e3-4416a11917f5 tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "cinder-95c53ee1-cc05-410f-bca6-2c02a99c5dc1-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:48 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe.036dfa39-ca69-41fe-88e2-0ad357cca181" returned: 0 in 0.472s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-036dfa39-ca69-41fe-88e2-0ad357cca181" released by "_delete_snapshot" :: held 2.573s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" released by "delete_snapshot" :: held 2.621s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['ab8b1b45-8a03-4ff1-a4aa-eb8a02cb9c4d', '39446231-1c8e-4b19-9686-c378af83c5b2', '3fa992a6-cda4-436f-bb64-9696b5dfd2c5', '0c14d2b8-927f-4815-a9f8-b7c35e41f5ad'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Delete snapshot completed successfully.
Sep 09 13:19:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e0238a32-024b-4453-93b7-c5dd50540958 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-036dfa39-ca69-41fe-88e2-0ad357cca181-delete_snapshot" released by "delete_snapshot" :: held 2.930s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Flow 'volume_create_manager' (fe06acb7-45f1-4857-8271-1d8f6129326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc599a9a-4384-484c-a8e4-de18e4ddb1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc599a9a-4384-484c-a8e4-de18e4ddb1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-134745532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67b1ce4-e76e-4aca-8676-7d6e0e10f228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a43a0c300b4124bb3ec4a1bfc23cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:50Z,use_quota=True,user_id='797cdf53269a49e791a4758923ae1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8764064-3de2-451d-821a-854f9e916380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8764064-3de2-451d-821a-854f9e916380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c995f8-11d4-4a19-b0d1-baf4d9c5e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c995f8-11d4-4a19-b0d1-baf4d9c5e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67b1ce4-e76e-4aca-8676-7d6e0e10f228', 'volume_name': 'volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78097be-785c-4b0e-bef5-5ee70a7cc5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78097be-785c-4b0e-bef5-5ee70a7cc5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446b185-3f56-4283-8d49-73629c55b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume e67b1ce4-e76e-4aca-8676-7d6e0e10f228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228', 'volume_size': 1}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-134745532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67b1ce4-e76e-4aca-8676-7d6e0e10f228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a43a0c300b4124bb3ec4a1bfc23cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:50Z,use_quota=True,user_id='797cdf53269a49e791a4758923ae1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Creating volume e67b1ce4-e76e-4aca-8676-7d6e0e10f228 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:49 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:49 devstack sudo[96904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 1073741824
Sep 09 13:19:49 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Acquiring lock "cinder-f19e7eef-83d6-4de5-8d2e-d60d4621ad09-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "cinder-f19e7eef-83d6-4de5-8d2e-d60d4621ad09-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Acquiring lock "cinder-quobyte-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "cinder-quobyte-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a559117-2f8e-40a4-bbb0-f695ed938071]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (f0e47e2b-f05d-473c-9fa9-40b7ddb34807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622cbb21-4012-49b0-b586-c25c5922b494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622cbb21-4012-49b0-b586-c25c5922b494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1584193853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ff2e19-efa3-4562-aad0-558162c5a07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:50Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa05e4e-6478-4ffb-9614-bd10163062b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa05e4e-6478-4ffb-9614-bd10163062b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014153b-5c64-4b22-b07f-488d154f98cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014153b-5c64-4b22-b07f-488d154f98cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ff2e19-efa3-4562-aad0-558162c5a07b', 'volume_name': 'volume-36ff2e19-efa3-4562-aad0-558162c5a07b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01353429-fe92-423b-b768-ed3465643f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01353429-fe92-423b-b768-ed3465643f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d12745-cd1b-4698-8dfe-c4eecbe6f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:50 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Volume 36ff2e19-efa3-4562-aad0-558162c5a07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ff2e19-efa3-4562-aad0-558162c5a07b', 'volume_size': 1}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:50 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09
Sep 09 13:19:50 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:50 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 1073741824" returned: 0 in 0.900s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:50 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228
Sep 09 13:19:50 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:51 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" returned: 0 in 0.529s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:51 devstack sudo[96919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09
Sep 09 13:19:51 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:51 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" returned: 0 in 0.341s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.499s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1584193853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ff2e19-efa3-4562-aad0-558162c5a07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:50Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Creating volume 36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:51 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446b185-3f56-4283-8d49-73629c55b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:51 devstack sudo[96922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b 1073741824
Sep 09 13:19:51 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53896a8-7881-40ef-bfc4-59ce3d9d1676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:51 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Volume volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 (e67b1ce4-e76e-4aca-8676-7d6e0e10f228): created successfully
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53896a8-7881-40ef-bfc4-59ce3d9d1676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Flow 'volume_create_manager' (fe06acb7-45f1-4857-8271-1d8f6129326e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f4f4d94c-72d3-42be-8e75-bf1c1e71bf9c tempest-VolumeQuotasAdminTestJSON-142771278 None] Created volume successfully.
Sep 09 13:19:51 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" returned: 0 in 0.471s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "cinder-quobyte-f19e7eef-83d6-4de5-8d2e-d60d4621ad09" released by "delete_volume" :: held 1.083s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Created reservations ['13b855dc-ff84-4b20-919f-d1f875cb3731', 'a71fcac6-276a-4dd9-98bd-a5ea7511d9fc', '4923da07-478c-4f75-91bc-988bf05add7e', 'f3038c76-f2a4-43de-a98f-ee27b8892ac1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:51 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:51 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:51 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b 1073741824" returned: 0 in 0.781s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:52 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:19:52 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:52 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.423s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Deleted volume successfully.
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0148bd38-df53-43fa-8b97-2ae5711124ee tempest-VolumesMetadataTest-506008514 None] Lock "cinder-f19e7eef-83d6-4de5-8d2e-d60d4621ad09-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:52 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d12745-cd1b-4698-8dfe-c4eecbe6f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ff2e19-efa3-4562-aad0-558162c5a07b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ca2a44-170e-404d-81aa-f2d64e5e1845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:52 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Volume volume-36ff2e19-efa3-4562-aad0-558162c5a07b (36ff2e19-efa3-4562-aad0-558162c5a07b): created successfully
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ca2a44-170e-404d-81aa-f2d64e5e1845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (f0e47e2b-f05d-473c-9fa9-40b7ddb34807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4ec5c00d-ca21-4344-a9e6-c1f8d807c1ae tempest-VolumesSnapshotTestJSON-1695755086 None] Created volume successfully.
Sep 09 13:19:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-21548d5c-0623-49cd-98e4-e49c198f3171 tempest-VolumeQuotasAdminTestJSON-1945530904 None] Transfer volume completed successfully.
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating offline snapshot bb05f853-0532-49e4-80b5-85e381b31e42 of volume 36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c8c24-5df9-42c7-ac29-38b2927b44b8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:53 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:19:53 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Acquiring lock "cinder-e67b1ce4-e76e-4aca-8676-7d6e0e10f228-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "cinder-e67b1ce4-e76e-4aca-8676-7d6e0e10f228-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Acquiring lock "cinder-quobyte-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "cinder-quobyte-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185691a-0416-49c3-98c2-99cdefe1d465]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:53 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.596s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:53 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 1G
Sep 09 13:19:53 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:53 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228
Sep 09 13:19:53 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:54 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" returned: 0 in 0.500s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:54 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228
Sep 09 13:19:54 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:54 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 1G" returned: 0 in 0.560s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ff2e19-efa3-4562-aad0-558162c5a07b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:54 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ff2e19-efa3-4562-aad0-558162c5a07b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:19:54 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:54 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "cinder-quobyte-e67b1ce4-e76e-4aca-8676-7d6e0e10f228" released by "delete_volume" :: held 0.939s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Created reservations ['713c0b80-f619-49c2-9ed1-0f498982396c', '1dcb555f-eb30-424e-80d3-d2ed02c4278c', '2859e39e-dcef-48ac-87a0-7aeb5e0d1189', '2917fec2-46e3-4833-8f65-c81873ee68b6'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:19:54 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ff2e19-efa3-4562-aad0-558162c5a07b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.495s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:54 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 is being set with open permissions: ugo+rw
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:54 devstack sudo[96986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:19:54 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:54 devstack sudo[96988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:19:54 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:55 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:19:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Deleted volume successfully.
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fb97dc33-c23a-4dd7-92ba-62f8ec375f93 tempest-VolumeQuotasAdminTestJSON-547076335 None] Lock "cinder-e67b1ce4-e76e-4aca-8676-7d6e0e10f228-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:19:55 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.463s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:55 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info
Sep 09 13:19:55 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:55 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:55 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info is being set with open permissions: ugo+rw
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:55 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info
Sep 09 13:19:55 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:55 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.info" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.809s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9093aced-8fa4-45e5-a163-00556d34e6b8 tempest-VolumesSnapshotTestJSON-1695755086 None] Create snapshot completed successfully
Sep 09 13:19:56 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (a210551e-cea1-4bdc-9324-e5997a4cf7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81389da-d4ad-4943-8c83-cd0c7b0bb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81389da-d4ad-4943-8c83-cd0c7b0bb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2025749324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ce4df1-eed7-40ff-87c8-5918a5912c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bb05f853-0532-49e4-80b5-85e381b31e42,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:57Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b455a11-2a4c-4480-9486-066dfcbd7a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b455a11-2a4c-4480-9486-066dfcbd7a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08dc6fc9-8ce0-48ec-9c1d-c9787f8666c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08dc6fc9-8ce0-48ec-9c1d-c9787f8666c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53ce4df1-eed7-40ff-87c8-5918a5912c1a', 'volume_name': 'volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a', 'volume_size': 2, 'snapshot_id': 'bb05f853-0532-49e4-80b5-85e381b31e42'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab1b7fd-808e-4aec-8fd0-279c3f5aeb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab1b7fd-808e-4aec-8fd0-279c3f5aeb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf2c0ba-4e9c-45ef-a391-4f7fc25bf3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume 53ce4df1-eed7-40ff-87c8-5918a5912c1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a', 'volume_size': 2, 'snapshot_id': 'bb05f853-0532-49e4-80b5-85e381b31e42'}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42-53ce4df1-eed7-40ff-87c8-5918a5912c1a" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42-53ce4df1-eed7-40ff-87c8-5918a5912c1a" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating volume 53ce4df1-eed7-40ff-87c8-5918a5912c1a from snapshot bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] snapshot: bb05f853-0532-49e4-80b5-85e381b31e42, volume: 53ce4df1-eed7-40ff-87c8-5918a5912c1a,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24a005-c44e-4a0f-b6d5-77c217d0fd42]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:57 devstack sudo[96998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:19:57 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:57 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.600s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ff2e19-efa3-4562-aad0-558162c5a07b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa5e57-6865-40bc-aa8e-5a74f2963314]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:19:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:19:58 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:19:58 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Flow 'volume_create_manager' (64277120-d7e1-4ac8-8115-43d4502bed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e118162-41ea-44f8-8101-97c3e187f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e118162-41ea-44f8-8101-97c3e187f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1410932890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498cd4e-d545-4e81-a7ac-572cde975ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080b9f3caaca46b483609404bd151d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:58Z,use_quota=True,user_id='5d06c41b6de5493c9b545ac75e390711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062bb499-9abd-49df-91b7-a414799007ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062bb499-9abd-49df-91b7-a414799007ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f6cf1e-78d9-491e-9935-bd0101924598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f6cf1e-78d9-491e-9935-bd0101924598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6498cd4e-d545-4e81-a7ac-572cde975ce5', 'volume_name': 'volume-6498cd4e-d545-4e81-a7ac-572cde975ce5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a744ed0a-7194-405a-a131-112106667bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a744ed0a-7194-405a-a131-112106667bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c2ac3c-1685-4557-a856-cccaac5df3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:19:58 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Volume 6498cd4e-d545-4e81-a7ac-572cde975ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6498cd4e-d545-4e81-a7ac-572cde975ce5', 'volume_size': 1}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:19:58 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.472s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:19:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:19:58 devstack sudo[97008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a
Sep 09 13:19:58 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:03 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a" returned: 0 in 5.525s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:03 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:20:03 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Converted 1024.00 MB image at 185.26 MB/s
Sep 09 13:20:03 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a is being set with open permissions: ugo+rw
Sep 09 13:20:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:04 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a
Sep 09 13:20:04 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:04 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" released by "_copy_volume_from_snapshot" :: held 7.024s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42-53ce4df1-eed7-40ff-87c8-5918a5912c1a" released by "_create_volume_from_snapshot" :: held 7.099s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.125s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.991s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1410932890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498cd4e-d545-4e81-a7ac-572cde975ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080b9f3caaca46b483609404bd151d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:19:58Z,use_quota=True,user_id='5d06c41b6de5493c9b545ac75e390711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Creating volume 6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:04 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:04 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 1073741824
Sep 09 13:20:04 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf2c0ba-4e9c-45ef-a391-4f7fc25bf3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a', 'volume_size': 2, 'snapshot_id': 'bb05f853-0532-49e4-80b5-85e381b31e42'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db961ec0-a09e-4294-a35a-d6dfaf7aef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:04 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a (53ce4df1-eed7-40ff-87c8-5918a5912c1a): created successfully
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db961ec0-a09e-4294-a35a-d6dfaf7aef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (a210551e-cea1-4bdc-9324-e5997a4cf7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d57622da-b9e7-4fc4-bf3c-7c5672bc13f8 tempest-VolumesSnapshotTestJSON-1695755086 None] Created volume successfully.
Sep 09 13:20:04 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 1073741824" returned: 0 in 0.432s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:04 devstack sudo[97046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:04 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-53ce4df1-eed7-40ff-87c8-5918a5912c1a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-53ce4df1-eed7-40ff-87c8-5918a5912c1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:05 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c2ac3c-1685-4557-a856-cccaac5df3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6498cd4e-d545-4e81-a7ac-572cde975ce5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f38b4b2-1239-42c0-9402-7fecb89ec489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:05 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Volume volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 (6498cd4e-d545-4e81-a7ac-572cde975ce5): created successfully
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f38b4b2-1239-42c0-9402-7fecb89ec489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Flow 'volume_create_manager' (64277120-d7e1-4ac8-8115-43d4502bed4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fe33eee7-2733-4cbf-b860-df6580417ac2 tempest-VolumesCloneTest-558559751 None] Created volume successfully.
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ad2f0-f565-4a56-b1ea-f1801e043aae]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:05 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a
Sep 09 13:20:05 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:05 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:05 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a
Sep 09 13:20:05 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:05 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-53ce4df1-eed7-40ff-87c8-5918a5912c1a" returned: 0 in 0.258s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-53ce4df1-eed7-40ff-87c8-5918a5912c1a" released by "delete_volume" :: held 0.681s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['4d08a306-1ca2-4bbb-be1f-666097ceca40', '0189955d-8a11-4822-9752-317adff29e56', 'ce8be3c6-549c-408d-b3b7-1f7246837fc7', 'e2428d30-b190-4a3b-9e50-ce49cbc37365'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:05 devstack sudo[97057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:05 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:06 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.281s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Deleted volume successfully.
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fcd8a617-5f6e-486e-932a-96a04a68ca10 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-53ce4df1-eed7-40ff-87c8-5918a5912c1a-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-bb05f853-0532-49e4-80b5-85e381b31e42-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-bb05f853-0532-49e4-80b5-85e381b31e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Deleting offline snapshot bb05f853-0532-49e4-80b5-85e381b31e42 of volume 36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] snapshot_file for this snap is: volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Flow 'volume_create_manager' (3b2a1a2b-4aea-4685-bdc1-e011485cd0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a698c1-d8fc-4ce7-b4e7-f0cc4163c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d0f5c0-1846-4248-96d4-3fe605b33a15]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a698c1-d8fc-4ce7-b4e7-f0cc4163c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-253562880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0277d8dc-e8ff-4446-9217-472aab9b8203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080b9f3caaca46b483609404bd151d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=6498cd4e-d545-4e81-a7ac-572cde975ce5,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:07Z,use_quota=True,user_id='5d06c41b6de5493c9b545ac75e390711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e90066-bf4e-4d9b-b04a-ba6afe400d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e90066-bf4e-4d9b-b04a-ba6afe400d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef20e92-7c31-4030-8673-162e61b1d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef20e92-7c31-4030-8673-162e61b1d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0277d8dc-e8ff-4446-9217-472aab9b8203', 'volume_name': 'volume-0277d8dc-e8ff-4446-9217-472aab9b8203', 'volume_size': 2, 'source_volid': '6498cd4e-d545-4e81-a7ac-572cde975ce5', 'source_volstatus': 'available'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb36989-5719-4628-8e08-e13345c0048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb36989-5719-4628-8e08-e13345c0048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f92a7b6-d19c-4c86-a14d-78b3154c1800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:06 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Volume 0277d8dc-e8ff-4446-9217-472aab9b8203: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0277d8dc-e8ff-4446-9217-472aab9b8203', 'volume_size': 2, 'source_volid': '6498cd4e-d545-4e81-a7ac-572cde975ce5', 'source_volstatus': 'available'}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:06 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Cloning volume 6498cd4e-d545-4e81-a7ac-572cde975ce5 to volume 0277d8dc-e8ff-4446-9217-472aab9b8203
Sep 09 13:20:06 devstack sudo[97060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:20:06 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Creating offline snapshot c34afc45-ed55-494e-9be2-85087c9a6c32 of volume 6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6908bd-68af-43d1-9382-0d292c94cb86]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:07 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:07 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:07 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.417s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ff2e19-efa3-4562-aad0-558162c5a07b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Flow 'volume_create_manager' (1aa0613a-72b8-4745-8201-08b816106cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b654c1e-9c1e-4ce4-b2dd-bd690ab6b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7a5c56-2c64-4fc7-ae08-8e8ad3c84be2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b654c1e-9c1e-4ce4-b2dd-bd690ab6b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-695581569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f592b8ab-a0d8-464f-a274-e515a26ed221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598ca67df3ac4a529891e0c451ffbba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:07Z,use_quota=True,user_id='c84e4363588d4395bad82d8111d548b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b5da55-9b9a-4b0f-baf3-ab72be1cc779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b5da55-9b9a-4b0f-baf3-ab72be1cc779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ebb978-f2e1-4916-ad83-f5ede5d2982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ebb978-f2e1-4916-ad83-f5ede5d2982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f592b8ab-a0d8-464f-a274-e515a26ed221', 'volume_name': 'volume-f592b8ab-a0d8-464f-a274-e515a26ed221', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe9495e-0719-4cd9-8022-6c01b03c3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe9495e-0719-4cd9-8022-6c01b03c3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e8afc0-dae1-47e3-b4c7-76f70b903054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:07 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Volume f592b8ab-a0d8-464f-a274-e515a26ed221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f592b8ab-a0d8-464f-a274-e515a26ed221', 'volume_size': 1}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:07 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.447s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:07 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:20:07 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:07 devstack sudo[97072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 1G
Sep 09 13:20:07 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:07 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 1G" returned: 0 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:07 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.598s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:07 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:07 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:07 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:20:07 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:08 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.334s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:08 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 is being set with open permissions: ugo+rw
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:08 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:08 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:08 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:08 devstack sudo[97094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42
Sep 09 13:20:08 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:08 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:08 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b.bb05f853-0532-49e4-80b5-85e381b31e42" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:08 devstack sudo[97098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info
Sep 09 13:20:08 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-bb05f853-0532-49e4-80b5-85e381b31e42" released by "_delete_snapshot" :: held 1.816s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" released by "delete_snapshot" :: held 1.852s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['858f5e29-d101-4ccb-b1b3-bea947a09833', 'd014e23e-2863-4afe-bf96-b1d9bd8eba56', '7f20202f-34d6-40c2-b804-138e715d3b8a', 'fce6d8b3-d409-4a2b-b6ec-61c12f032546'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Delete snapshot completed successfully.
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f65faa24-1e48-41ab-af20-7846030a4ef8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-bb05f853-0532-49e4-80b5-85e381b31e42-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:08 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info" returned: 0 in 0.302s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:08 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info is being set with open permissions: ugo+rw
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:08 devstack sudo[97102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info
Sep 09 13:20:08 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-36ff2e19-efa3-4562-aad0-558162c5a07b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-36ff2e19-efa3-4562-aad0-558162c5a07b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0817898a-42cf-4788-bc36-1aa735bdd951]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.info" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] snapshot: c34afc45-ed55-494e-9be2-85087c9a6c32, volume: 0277d8dc-e8ff-4446-9217-472aab9b8203,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f86f8e-fe43-4743-b515-3cc0aecdaec7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:20:09 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:09 devstack sudo[97106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:09 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:09 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.386s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b
Sep 09 13:20:09 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:09 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.410s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6498cd4e-d545-4e81-a7ac-572cde975ce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3795486-04e4-4f7b-a65f-dc5e386ab26f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:09 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:09 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-36ff2e19-efa3-4562-aad0-558162c5a07b" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-36ff2e19-efa3-4562-aad0-558162c5a07b" released by "delete_volume" :: held 0.710s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['ff1f8272-ddaf-479c-ae8b-91267e00aa6d', 'f6ab1a5e-4ef3-449e-b155-c1826430bd35', 'b3c67f48-48c8-421e-af22-83e69320f690', '4bd0f19c-6191-4dd2-915e-67be5f3a34c0'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:09 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:09 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.376s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:20:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:09 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203
Sep 09 13:20:09 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:10 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:10 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Deleted volume successfully.
Sep 09 13:20:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cc5bad5-ed3e-471d-9d35-a519f459f6ff tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-36ff2e19-efa3-4562-aad0-558162c5a07b-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:10 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (8a0143d6-12ea-4acf-b0f0-d2a88941ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbeed9a-4143-46df-9ce2-045d17a4b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbeed9a-4143-46df-9ce2-045d17a4b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-203507549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:11Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a98413e-013b-4a03-a1b2-f34e8f60c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a98413e-013b-4a03-a1b2-f34e8f60c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f1143d-91e3-4d3f-bc99-e226c3b444f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f1143d-91e3-4d3f-bc99-e226c3b444f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d', 'volume_name': 'volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4ffa12-ad6f-4adb-b860-f960571014d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4ffa12-ad6f-4adb-b860-f960571014d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1473eaf3-86ca-4746-b69a-ce041c548073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:11 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume 96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d', 'volume_size': 1}
Sep 09 13:20:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:15 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203" returned: 0 in 5.571s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:20:15 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Converted 1024.00 MB image at 183.77 MB/s
Sep 09 13:20:15 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 is being set with open permissions: ugo+rw
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:15 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203
Sep 09 13:20:15 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:15 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203" returned: 0 in 0.342s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" released by "_copy_volume_from_snapshot" :: held 6.779s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-quobyte-c34afc45-ed55-494e-9be2-85087c9a6c32" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-c34afc45-ed55-494e-9be2-85087c9a6c32" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Deleting offline snapshot c34afc45-ed55-494e-9be2-85087c9a6c32 of volume 6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] snapshot_file for this snap is: volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a7718-6d3a-4e7e-a60d-3191eb40abff]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:16 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:16 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:16 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6498cd4e-d545-4e81-a7ac-572cde975ce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6dd71-d149-4f51-bdde-d4220cf47e68]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:16 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:16 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:16 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.523s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:16 devstack sudo[97224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:16 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:17 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.361s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:17 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32
Sep 09 13:20:17 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:17 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5.c34afc45-ed55-494e-9be2-85087c9a6c32" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-c34afc45-ed55-494e-9be2-85087c9a6c32" released by "_delete_snapshot" :: held 1.639s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.692s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.217s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-695581569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f592b8ab-a0d8-464f-a274-e515a26ed221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598ca67df3ac4a529891e0c451ffbba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:07Z,use_quota=True,user_id='c84e4363588d4395bad82d8111d548b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Creating volume f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:17 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f92a7b6-d19c-4c86-a14d-78b3154c1800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0277d8dc-e8ff-4446-9217-472aab9b8203', 'volume_size': 2, 'source_volid': '6498cd4e-d545-4e81-a7ac-572cde975ce5', 'source_volstatus': 'available'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:17 devstack sudo[97233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 1073741824
Sep 09 13:20:17 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc7989b-de31-4323-8811-84fbe0839b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Volume volume-0277d8dc-e8ff-4446-9217-472aab9b8203 (0277d8dc-e8ff-4446-9217-472aab9b8203): created successfully
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc7989b-de31-4323-8811-84fbe0839b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Flow 'volume_create_manager' (3b2a1a2b-4aea-4685-bdc1-e011485cd0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:17 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-173e8475-3ffe-49ec-8c02-10acbb8d9248 tempest-VolumesCloneTest-558559751 None] Created volume successfully.
Sep 09 13:20:18 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 1073741824" returned: 0 in 0.554s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:18 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221
Sep 09 13:20:18 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-0277d8dc-e8ff-4446-9217-472aab9b8203-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "cinder-0277d8dc-e8ff-4446-9217-472aab9b8203-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b9cf6-3285-4f12-9a98-f2a3b2b4b213]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:18 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221" returned: 0 in 0.296s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.238s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-203507549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:11Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating volume 96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:18 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:18 devstack sudo[97242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203
Sep 09 13:20:18 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:18 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d 1073741824
Sep 09 13:20:18 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-f98723e3-3811-43fd-ade0-409c529fd4a1 req-9c3e489a-362c-4768-9e93-0b39d1481704 tempest-AttachVolumeNegativeTest-389404715 None] Terminate volume connection completed successfully.
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-f98723e3-3811-43fd-ade0-409c529fd4a1 req-9c3e489a-362c-4768-9e93-0b39d1481704 tempest-AttachVolumeNegativeTest-389404715 None] Deleting attachment 460044ff-1048-45f8-ae7f-1f458fc5bc03. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e8afc0-dae1-47e3-b4c7-76f70b903054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f592b8ab-a0d8-464f-a274-e515a26ed221', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b63eb85-b7eb-4168-981c-ab6dbc48e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:18 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Volume volume-f592b8ab-a0d8-464f-a274-e515a26ed221 (f592b8ab-a0d8-464f-a274-e515a26ed221): created successfully
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b63eb85-b7eb-4168-981c-ab6dbc48e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Flow 'volume_create_manager' (1aa0613a-72b8-4745-8201-08b816106cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b8423df8-d856-4bde-b99a-e0f0339d0e5a tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Created volume successfully.
Sep 09 13:20:18 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203" returned: 0 in 0.450s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:18 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203
Sep 09 13:20:18 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:18 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d 1073741824" returned: 0 in 0.460s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:19 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:19 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:19 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0277d8dc-e8ff-4446-9217-472aab9b8203" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-0277d8dc-e8ff-4446-9217-472aab9b8203" released by "delete_volume" :: held 0.765s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Created reservations ['bb47668d-3c8a-482b-8df6-714a233af00a', 'ae031a47-228b-43b2-b306-dc96d8bcfe0f', '703f2fce-775c-488d-98d9-dae4ddaace12', '482a3578-132e-4043-be36-088c9741906b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:19 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:19 devstack sudo[97263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1473eaf3-86ca-4746-b69a-ce041c548073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:19 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2150fd27-5d2f-4296-854f-8f58f4d679a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:19 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d (96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d): created successfully
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2150fd27-5d2f-4296-854f-8f58f4d679a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (8a0143d6-12ea-4acf-b0f0-d2a88941ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5ced8946-2088-4cd0-a8f5-9b627b8cebf7 tempest-VolumesSnapshotTestJSON-1695755086 None] Created volume successfully.
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-6498cd4e-d545-4e81-a7ac-572cde975ce5-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "cinder-6498cd4e-d545-4e81-a7ac-572cde975ce5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Acquiring lock "cinder-quobyte-6498cd4e-d545-4e81-a7ac-572cde975ce5" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-6498cd4e-d545-4e81-a7ac-572cde975ce5" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:19 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.461s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68b1b3-a11a-4d18-a99b-1ea877c2a889]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Deleted volume successfully.
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6d20bd1f-bba5-4094-9e14-cdfe551bbf08 tempest-VolumesCloneTest-558559751 None] Lock "cinder-0277d8dc-e8ff-4446-9217-472aab9b8203-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Creating offline snapshot 9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 of volume f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d173703-34e2-4d77-9ada-d655fafdeac8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:19 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:19 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:20 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221
Sep 09 13:20:20 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:20 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.698s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:20 devstack sudo[97296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5
Sep 09 13:20:20 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:20 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221" returned: 0 in 0.646s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:20 devstack sudo[97300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 1G
Sep 09 13:20:20 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:20 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6498cd4e-d545-4e81-a7ac-572cde975ce5" returned: 0 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "cinder-quobyte-6498cd4e-d545-4e81-a7ac-572cde975ce5" released by "delete_volume" :: held 1.160s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Created reservations ['c2911dae-aeb4-4193-a7c1-6a99a297c691', 'f6855de6-53db-4167-9c89-b04eb1690262', '4cc171cd-06ee-41e3-aa05-ccf1c44f2b7d', '075cc7d4-60af-47f1-b446-60832eaea158'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:21 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:21 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:21 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 1G" returned: 0 in 0.565s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f592b8ab-a0d8-464f-a274-e515a26ed221 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:21 devstack sudo[97311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f592b8ab-a0d8-464f-a274-e515a26ed221 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3
Sep 09 13:20:21 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:21 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Deleted volume successfully.
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-06f3c315-2410-4745-8cb8-88bb4619c2d3 tempest-VolumesCloneTest-558559751 None] Lock "cinder-6498cd4e-d545-4e81-a7ac-572cde975ce5-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:21 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f592b8ab-a0d8-464f-a274-e515a26ed221 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" returned: 0 in 0.425s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:21 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 is being set with open permissions: ugo+rw
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:21 devstack sudo[97318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3
Sep 09 13:20:21 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:21 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:21 devstack sudo[97321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info
Sep 09 13:20:21 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:22 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:22 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info is being set with open permissions: ugo+rw
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:22 devstack sudo[97324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info
Sep 09 13:20:22 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:22 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.info" returned: 0 in 0.258s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.194s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Creating offline snapshot 84dea444-c646-473d-8b73-179ae1e88323 of volume 96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:20:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ed1b6f91-9b36-4906-a95b-67aa3e058e22 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Create snapshot completed successfully
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d1496-eea5-45dd-a291-62935b2885c7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:22 devstack sudo[97327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:22 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:22 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.420s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:22 devstack sudo[97333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 1G
Sep 09 13:20:22 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:23 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 1G" returned: 0 in 0.655s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:23 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:23 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "cinder-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "cinder-quobyte-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Deleting offline snapshot 9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 of volume f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] snapshot_file for this snap is: volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0671a5a7-2032-4bb2-bb8b-396af640e1ec]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:23 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3
Sep 09 13:20:23 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:24 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.483s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:24 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 is being set with open permissions: ugo+rw
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:24 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:24 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:24 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" returned: 0 in 0.444s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f592b8ab-a0d8-464f-a274-e515a26ed221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191298f-828c-437b-b87a-af0bc67dee04]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:24 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221
Sep 09 13:20:24 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:24 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.347s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:24 devstack sudo[97357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info
Sep 09 13:20:24 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:24 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221" returned: 0 in 0.539s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:24 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3
Sep 09 13:20:24 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:24 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info" returned: 0 in 0.425s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:24 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info is being set with open permissions: ugo+rw
Sep 09 13:20:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:24 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info
Sep 09 13:20:24 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:25 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.info" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:25 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.833s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" returned: 0 in 0.509s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:25 devstack sudo[97371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3
Sep 09 13:20:25 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-60c2f089-14d1-4950-99b1-259983b51bbe tempest-VolumesSnapshotTestJSON-1695755086 None] Create snapshot completed successfully
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:20:25 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221.9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3" released by "_delete_snapshot" :: held 1.968s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" released by "delete_snapshot" :: held 2.015s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Created reservations ['cb816f35-a087-4973-b705-e1b0fcf60b5f', '355e16b6-4a68-4c16-9329-c677a6478aed', 'a7dfbf91-eb3a-430c-97b9-6b31b0dab200', 'adab860a-3791-4ba1-8462-144c32742979'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Delete snapshot completed successfully.
Sep 09 13:20:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0cfe8375-c6cf-4970-b1a5-c8204b65f3c2 tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-9e3b7d8d-fa43-406f-b18c-5eebd9de3db3-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (7137c4a1-6498-4330-b066-7d3c84cdc428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4649ec-0c27-4a10-a31f-5630969394ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4649ec-0c27-4a10-a31f-5630969394ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-717705420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5f2968-a631-41f6-80ca-66e624194149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2396a49101452a93c370511fa9863b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84dea444-c646-473d-8b73-179ae1e88323,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:26Z,use_quota=True,user_id='2835d965c3844503806356688937609e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da77d97f-f7a6-484c-971c-e6a1d1b90cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da77d97f-f7a6-484c-971c-e6a1d1b90cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece39b30-7841-461f-943d-58903a0e3316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece39b30-7841-461f-943d-58903a0e3316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b5f2968-a631-41f6-80ca-66e624194149', 'volume_name': 'volume-0b5f2968-a631-41f6-80ca-66e624194149', 'volume_size': 1, 'snapshot_id': '84dea444-c646-473d-8b73-179ae1e88323'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43815414-9031-431a-ad92-865ba33bb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43815414-9031-431a-ad92-865ba33bb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71ad1f3-bda3-40b1-b09f-ace6f56024da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume 0b5f2968-a631-41f6-80ca-66e624194149: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b5f2968-a631-41f6-80ca-66e624194149', 'volume_size': 1, 'snapshot_id': '84dea444-c646-473d-8b73-179ae1e88323'}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323-0b5f2968-a631-41f6-80ca-66e624194149" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323-0b5f2968-a631-41f6-80ca-66e624194149" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating volume 0b5f2968-a631-41f6-80ca-66e624194149 from snapshot 84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] snapshot: 84dea444-c646-473d-8b73-179ae1e88323, volume: 0b5f2968-a631-41f6-80ca-66e624194149,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e018bc4-51bb-4163-bc95-b2f1c3e1c25a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:26 devstack sudo[97374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:26 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Flow 'volume_create_manager' (f741f802-1560-4528-9a09-43939fecd7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98189611-6929-463e-b476-1470f7d0c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98189611-6929-463e-b476-1470f7d0c358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1754341819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7069f5bc-427c-4c89-b868-93beb4a6cf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f956ca2d7554a418f0de6cf126110d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:27Z,use_quota=True,user_id='9a3280f3d01f4f46a101640082998ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b0daa2-5579-45a6-a385-0d396f1f8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b0daa2-5579-45a6-a385-0d396f1f8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90d0590-051a-42ed-a61f-015de9238e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90d0590-051a-42ed-a61f-015de9238e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7069f5bc-427c-4c89-b868-93beb4a6cf0d', 'volume_name': 'volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a70552-ddf5-46ca-8bf0-4ea1df2934d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a70552-ddf5-46ca-8bf0-4ea1df2934d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea97f0-3c19-4610-8839-93774bb555e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Volume 7069f5bc-427c-4c89-b868-93beb4a6cf0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d', 'volume_size': 1}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:26 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.465s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "cinder-f592b8ab-a0d8-464f-a274-e515a26ed221-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd4137-2521-451b-b5ce-360e959de95b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-f592b8ab-a0d8-464f-a274-e515a26ed221-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef5fc86-6cf4-4104-8b87-1bcd61c8cd8c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:27 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:27 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:27 devstack sudo[97380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221
Sep 09 13:20:27 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:27 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.457s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:27 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149
Sep 09 13:20:27 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:27 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221" returned: 0 in 0.419s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:27 devstack sudo[97395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221
Sep 09 13:20:27 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:27 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f592b8ab-a0d8-464f-a274-e515a26ed221" returned: 0 in 0.278s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-quobyte-f592b8ab-a0d8-464f-a274-e515a26ed221" released by "delete_volume" :: held 0.753s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Created reservations ['2b2cd608-ef80-49ab-9ad1-a7fb7969b6f4', 'ea461f60-12d7-4598-8256-60325d00080b', '3198015b-d2b7-4c4b-aaeb-cd8fd35620c0', '3f530a4d-37e9-45d7-a374-93dd2969a005'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:27 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:27 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:28 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.938s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:28 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Deleted volume successfully.
Sep 09 13:20:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1971c5dd-3938-4b2a-a60a-0267b96a1bbf tempest-VolumeSnapshotQuotasNegativeTestJSON-102800166 None] Lock "cinder-f592b8ab-a0d8-464f-a274-e515a26ed221-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:33 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149" returned: 0 in 6.111s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:20:33 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Converted 1024.00 MB image at 167.55 MB/s
Sep 09 13:20:33 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 is being set with open permissions: ugo+rw
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:33 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149
Sep 09 13:20:33 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:33 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" released by "_copy_volume_from_snapshot" :: held 7.433s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323-0b5f2968-a631-41f6-80ca-66e624194149" released by "_create_volume_from_snapshot" :: held 7.505s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.522s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.108s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1754341819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7069f5bc-427c-4c89-b868-93beb4a6cf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f956ca2d7554a418f0de6cf126110d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:27Z,use_quota=True,user_id='9a3280f3d01f4f46a101640082998ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Creating volume 7069f5bc-427c-4c89-b868-93beb4a6cf0d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:33 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:33 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d 1073741824
Sep 09 13:20:33 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71ad1f3-bda3-40b1-b09f-ace6f56024da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5f2968-a631-41f6-80ca-66e624194149', 'volume_size': 1, 'snapshot_id': '84dea444-c646-473d-8b73-179ae1e88323'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406bfcfc-3104-4a0a-8d42-5c588b067f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Volume volume-0b5f2968-a631-41f6-80ca-66e624194149 (0b5f2968-a631-41f6-80ca-66e624194149): created successfully
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406bfcfc-3104-4a0a-8d42-5c588b067f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Flow 'volume_create_manager' (7137c4a1-6498-4330-b066-7d3c84cdc428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c5b64903-5937-40f1-b57a-ce64c70d5076 tempest-VolumesSnapshotTestJSON-1695755086 None] Created volume successfully.
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-0b5f2968-a631-41f6-80ca-66e624194149-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-0b5f2968-a631-41f6-80ca-66e624194149-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaa219a-c337-49d8-aeeb-f1b69feca656]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:34 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d 1073741824" returned: 0 in 0.634s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:34 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d
Sep 09 13:20:34 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:34 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149
Sep 09 13:20:34 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:34 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea97f0-3c19-4610-8839-93774bb555e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433baf78-c155-41c7-8eef-99db0cef1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:34 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149" returned: 0 in 0.525s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:35 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Volume volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d (7069f5bc-427c-4c89-b868-93beb4a6cf0d): created successfully
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433baf78-c155-41c7-8eef-99db0cef1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:35 devstack sudo[97457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149
Sep 09 13:20:35 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Flow 'volume_create_manager' (f741f802-1560-4528-9a09-43939fecd7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2a71ea40-0dd7-4ff9-86ad-f8f974618ff2 tempest-VolumesNegativeTest-539394325 None] Created volume successfully.
Sep 09 13:20:35 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b5f2968-a631-41f6-80ca-66e624194149" returned: 0 in 0.455s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-0b5f2968-a631-41f6-80ca-66e624194149" released by "delete_volume" :: held 1.054s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['ec5e7d97-0a95-40d4-b80f-e9371c146504', '5fcd2dfa-0362-4efc-b3de-c189aedc4290', 'ad263e52-b146-4b5b-b654-e97aac600e81', 'b5f7d19b-9679-4655-a98c-3055a87ebf27'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:35 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:35 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:36 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.577s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Deleted volume successfully.
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8968e3d0-61b6-41f6-b5c3-e95d8e7832f7 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-0b5f2968-a631-41f6-80ca-66e624194149-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-84dea444-c646-473d-8b73-179ae1e88323-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-84dea444-c646-473d-8b73-179ae1e88323-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Deleting offline snapshot 84dea444-c646-473d-8b73-179ae1e88323 of volume 96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] snapshot_file for this snap is: volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecdf36a-8f59-4169-ac23-b56ae8f23304]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:37 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:37 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:37 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.685s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:20:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd17393-ae2b-47ee-8f11-015859916ce6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:37 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:37 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:38 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.948s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:38 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:38 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:39 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.796s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:39 devstack sudo[97550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323
Sep 09 13:20:39 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:40 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d.84dea444-c646-473d-8b73-179ae1e88323" returned: 0 in 0.791s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=129,cinder:INSERT=35,cinder:UPDATE=143,cinder:DELETE=14 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=118,cinder:INSERT=39,cinder:UPDATE=149,cinder:DELETE=12 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-84dea444-c646-473d-8b73-179ae1e88323" released by "_delete_snapshot" :: held 3.463s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" released by "delete_snapshot" :: held 3.511s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['787f2f29-8528-4c9d-b0ec-2794fdfbb15e', '3f01122c-c1f9-4d95-9d85-39d3d540d6b9', '3d96498e-60f8-4330-854e-ff9269747e5d', 'beb820cb-ee7c-4799-a015-d57b0e7a6aeb'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Delete snapshot completed successfully.
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e7415a7c-252c-475c-8298-d21be1ad88ec tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-84dea444-c646-473d-8b73-179ae1e88323-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Flow 'volume_create_manager' (6e096159-d02c-41b1-bc5c-09cf695ab843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6b379-31b6-4cc4-9b17-af7735e06a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe6b379-31b6-4cc4-9b17-af7735e06a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1474870756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945757bc-ec97-4123-bcbe-69d278946dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0197653ac4c09bfed8462fbced6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:41Z,use_quota=True,user_id='1d3f3a5176a546328f18da708fa99314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cf9894-209a-4aeb-b6bc-1b44b69f74a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cf9894-209a-4aeb-b6bc-1b44b69f74a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863c63fc-2f82-45d9-b342-be809e7f01c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863c63fc-2f82-45d9-b342-be809e7f01c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '945757bc-ec97-4123-bcbe-69d278946dc2', 'volume_name': 'volume-945757bc-ec97-4123-bcbe-69d278946dc2', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460bbb30>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dba60d2-e555-4536-91dd-3a1a46f14f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dba60d2-e555-4536-91dd-3a1a46f14f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff846466-8534-4cf9-813f-5929eefbab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Volume 945757bc-ec97-4123-bcbe-69d278946dc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-945757bc-ec97-4123-bcbe-69d278946dc2', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460bbb30>}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Trying to clone 945757bc-ec97-4123-bcbe-69d278946dc2 from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" acquired by "delete_volume" :: waited 0.055s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f02fa-4e2a-416e-8493-1fbe43654a18]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:42 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:42 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:20:42 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e49b7-aecd-4631-a02c-830f9d463189]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:42 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD
Sep 09 13:20:42 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:42 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.745s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:42 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d
Sep 09 13:20:42 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:42 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 is fetched for user 1d3f3a5176a546328f18da708fa99314. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d473e68-2e7d-496c-b03d-507bb67bfbd3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:43 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" returned: 0 in 0.419s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:43 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD
Sep 09 13:20:43 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d" released by "delete_volume" :: held 1.301s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['91ad0d00-84e6-4741-9a4a-b49307d2f560', 'd078d002-b70d-43ce-b1ed-c43147a4e16e', '58b5590b-129e-4a6e-b16c-4cf3d30a58fc', 'eab319af-ec48-4cef-aa79-ac5085458d5f'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:43 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1474870756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945757bc-ec97-4123-bcbe-69d278946dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a0197653ac4c09bfed8462fbced6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:41Z,use_quota=True,user_id='1d3f3a5176a546328f18da708fa99314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Creating volume 945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:43 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:43 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:43 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:43 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1073741824
Sep 09 13:20:43 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:43 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Deleted volume successfully.
Sep 09 13:20:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eef5598e-5282-4e64-932c-3bcf6e37d47c tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-96a5a6e9-4ebf-4858-bc60-1b28d07cbf4d-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-01673114-d016-435c-9663-560ba36c9dbe-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:44 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1073741824" returned: 0 in 0.756s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-01673114-d016-435c-9663-560ba36c9dbe-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:44 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2
Sep 09 13:20:44 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d43820-caba-482f-8b0d-b482f7a32bda]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:44 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe
Sep 09 13:20:44 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:44 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Attempting download of 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 945757bc-ec97-4123-bcbe-69d278946dc2. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[26283479-3e20-4332-8b2a-5b267c09c53c]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:45 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy
Sep 09 13:20:45 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:45 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe" returned: 0 in 1.077s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:45 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe
Sep 09 13:20:45 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:45 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy" returned: 0 in 1.139s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:45 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-01673114-d016-435c-9663-560ba36c9dbe" returned: 0 in 0.632s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-quobyte-01673114-d016-435c-9663-560ba36c9dbe" released by "delete_volume" :: held 1.799s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Created reservations ['abb5b5f5-c043-4b48-a366-ab1be4b02fcc', 'ca94d4ce-c7b9-4c0c-835a-c055c3cffea0', '49154cbd-af00-48de-8247-126cc3a5fde0', '25af072e-a2d3-4f6e-9a3d-329930bb2577'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:46 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy
Sep 09 13:20:46 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:46 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:46 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:46 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy" returned: 1 in 0.840s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_wi6fmnvy' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[113cc777-036d-4d8a-b3c1-50007f8f9c62]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:47 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.595s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:47 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD
Sep 09 13:20:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Deleted volume successfully.
Sep 09 13:20:47 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f8920b4-4062-47f4-bad0-60067b8659a8 tempest-VolumesSnapshotTestJSON-1695755086 None] Lock "cinder-01673114-d016-435c-9663-560ba36c9dbe-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:47 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] 11a0fc37-23e8-4a61-8370-95b767ddcca5 was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:20:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:47 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2
Sep 09 13:20:47 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:50 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2" returned: 0 in 3.094s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:50 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_a_6xygcldevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:20:50 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Converted 112.00 MB image at 36.19 MB/s
Sep 09 13:20:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:50 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1G
Sep 09 13:20:50 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:51 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 1G" returned: 0 in 0.474s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Downloaded image 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 945757bc-ec97-4123-bcbe-69d278946dc2 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 for user 1d3f3a5176a546328f18da708fa99314 is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Marking volume 945757bc-ec97-4123-bcbe-69d278946dc2 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Copying metadata from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 to 945757bc-ec97-4123-bcbe-69d278946dc2. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Creating volume glance metadata for volume 945757bc-ec97-4123-bcbe-69d278946dc2 backed by image 11a0fc37-23e8-4a61-8370-95b767ddcca5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff846466-8534-4cf9-813f-5929eefbab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945757bc-ec97-4123-bcbe-69d278946dc2', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab5460bbb30>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952ce91-4418-423e-ac80-d0082759d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:51 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Volume volume-945757bc-ec97-4123-bcbe-69d278946dc2 (945757bc-ec97-4123-bcbe-69d278946dc2): created successfully
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952ce91-4418-423e-ac80-d0082759d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Flow 'volume_create_manager' (6e096159-d02c-41b1-bc5c-09cf695ab843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b8b972db-071e-4aa8-aa81-764199e74fa2 tempest-VolumesImageMetadata-1433491748 None] Created volume successfully.
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Acquiring lock "cinder-945757bc-ec97-4123-bcbe-69d278946dc2-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "cinder-945757bc-ec97-4123-bcbe-69d278946dc2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Acquiring lock "cinder-quobyte-945757bc-ec97-4123-bcbe-69d278946dc2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "cinder-quobyte-945757bc-ec97-4123-bcbe-69d278946dc2" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e9b61-5f9a-41d1-8991-598b83a7533e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:20:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:52 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2
Sep 09 13:20:52 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:53 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2" returned: 0 in 0.434s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:53 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2
Sep 09 13:20:53 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:53 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-945757bc-ec97-4123-bcbe-69d278946dc2" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "cinder-quobyte-945757bc-ec97-4123-bcbe-69d278946dc2" released by "delete_volume" :: held 0.761s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Created reservations ['c08a6343-1f3a-4860-ba26-eb0aa498725e', '63fdab6c-c46c-48a3-a936-2d9b3f928ed2', '8c503068-3f43-4917-9b76-4a53448c2d95', '8a863c1a-d349-4964-bc44-5f795da3a942'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:53 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:20:53 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:53 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:53 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:20:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Deleted volume successfully.
Sep 09 13:20:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b60a4b5-0252-496a-85c4-3464f445e2b9 tempest-VolumesImageMetadata-1433491748 None] Lock "cinder-945757bc-ec97-4123-bcbe-69d278946dc2-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:20:58 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:20:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (bc06f2e3-89df-489a-8a56-931aae3a8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:20:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96299991-31c2-4d2c-962e-a54a99095f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96299991-31c2-4d2c-962e-a54a99095f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1063987460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea97529-4ab3-4cc0-b72f-b60dc827dcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85421c0abcff41938f316ce46686bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:59Z,use_quota=True,user_id='287e79ed59954764b8f85d710d90786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2426db6-6c22-4731-a772-929e340b09af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2426db6-6c22-4731-a772-929e340b09af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648ebc3a-cc66-4135-81e5-895c4a17b432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648ebc3a-cc66-4135-81e5-895c4a17b432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea97529-4ab3-4cc0-b72f-b60dc827dcd9', 'volume_name': 'volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bba748-954a-4bd8-868d-44356bb0f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bba748-954a-4bd8-868d-44356bb0f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d0f12-f1e9-4802-bbcc-8a8b22a0d698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9', 'volume_size': 1}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1063987460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea97529-4ab3-4cc0-b72f-b60dc827dcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85421c0abcff41938f316ce46686bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:20:59Z,use_quota=True,user_id='287e79ed59954764b8f85d710d90786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Creating volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:20:59 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:59 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 1073741824
Sep 09 13:20:59 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:59 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 1073741824" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:20:59 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:20:59 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:20:59 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d0f12-f1e9-4802-bbcc-8a8b22a0d698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173a602-b01c-47cf-952c-0f977a49976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:20:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Volume volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 (6ea97529-4ab3-4cc0-b72f-b60dc827dcd9): created successfully
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173a602-b01c-47cf-952c-0f977a49976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:20:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (bc06f2e3-89df-489a-8a56-931aae3a8891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:00 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3589d4e7-1085-4296-9c80-a0e1987f8604 tempest-VolumesDeleteCascade-1445845252 None] Created volume successfully.
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Acquiring lock "cinder-7069f5bc-427c-4c89-b868-93beb4a6cf0d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "cinder-7069f5bc-427c-4c89-b868-93beb4a6cf0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Acquiring lock "cinder-quobyte-7069f5bc-427c-4c89-b868-93beb4a6cf0d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "cinder-quobyte-7069f5bc-427c-4c89-b868-93beb4a6cf0d" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe02262-9df0-48c8-a70b-3817877cd00d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:01 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d
Sep 09 13:21:01 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Creating offline snapshot 0b70397a-8760-4c28-a85e-a2c081553eda of volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f96a72-1a64-4215-af79-28a530b69dfe]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:01 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d" returned: 0 in 0.605s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:01 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:01 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:01 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d
Sep 09 13:21:01 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (f871bc81-45ea-4a28-b753-0e1d0f29a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9599dcb4-c2e3-439c-9b70-02ab107acbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9599dcb4-c2e3-439c-9b70-02ab107acbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-529758212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e3f286-08bf-44e2-9484-8d41cd5905ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:02Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e018e2c-3604-49f7-877f-d9e095d626d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e018e2c-3604-49f7-877f-d9e095d626d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71098351-fb80-4495-a974-6b2a5fac6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71098351-fb80-4495-a974-6b2a5fac6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e3f286-08bf-44e2-9484-8d41cd5905ad', 'volume_name': 'volume-05e3f286-08bf-44e2-9484-8d41cd5905ad', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aefcc23-eb44-4ec0-b18b-c39cf218d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aefcc23-eb44-4ec0-b18b-c39cf218d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82530f3e-0486-43d7-ac1f-57d0212a3a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:01 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Volume 05e3f286-08bf-44e2-9484-8d41cd5905ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e3f286-08bf-44e2-9484-8d41cd5905ad', 'volume_size': 1}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:01 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7069f5bc-427c-4c89-b868-93beb4a6cf0d" returned: 0 in 0.310s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "cinder-quobyte-7069f5bc-427c-4c89-b868-93beb4a6cf0d" released by "delete_volume" :: held 0.995s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:01 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.544s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:01 devstack sudo[97800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda 1G
Sep 09 13:21:01 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Created reservations ['4d73cc3f-6653-48c1-bb2a-9f572c932a7f', '20667aaf-eefd-4e91-a4c6-9e771c22966e', '48e46b30-2434-4f99-85e6-7fb69997c671', '1158f2c7-4e7b-4f50-a98b-2c51fcb34d19'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:02 devstack sudo[97802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:02 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:02 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda 1G" returned: 0 in 0.657s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:02 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.374s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Deleted volume successfully.
Sep 09 13:21:02 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:02 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ab772c59-7d19-474a-8698-31d5bbac271f tempest-VolumesNegativeTest-539394325 None] Lock "cinder-7069f5bc-427c-4c89-b868-93beb4a6cf0d-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:02 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.327s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:02 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda is being set with open permissions: ugo+rw
Sep 09 13:21:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:02 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:02 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:03 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:03 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info
Sep 09 13:21:03 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:03 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:03 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info is being set with open permissions: ugo+rw
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:03 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info
Sep 09 13:21:03 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:03 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.info" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-529758212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e3f286-08bf-44e2-9484-8d41cd5905ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:02Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Creating volume 05e3f286-08bf-44e2-9484-8d41cd5905ad {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:03 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:03 devstack sudo[97823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad 1073741824
Sep 09 13:21:03 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-dcd5b964-42bf-40f7-ad2d-45b35cd65139 tempest-VolumesDeleteCascade-1445845252 None] Create snapshot completed successfully
Sep 09 13:21:04 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad 1073741824" returned: 0 in 0.563s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:04 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad
Sep 09 13:21:04 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:04 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad" returned: 0 in 0.395s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.031s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82530f3e-0486-43d7-ac1f-57d0212a3a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e3f286-08bf-44e2-9484-8d41cd5905ad', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd89420-793f-4018-991f-7e6ef3ee7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Creating offline snapshot 9a48036d-3e58-483e-b9cd-20d69ebfe72e of volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:05 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Volume volume-05e3f286-08bf-44e2-9484-8d41cd5905ad (05e3f286-08bf-44e2-9484-8d41cd5905ad): created successfully
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd89420-793f-4018-991f-7e6ef3ee7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (f871bc81-45ea-4a28-b753-0e1d0f29a51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e3c6c-8637-4ee0-ac40-69f9c6b0d098]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f9e34110-7696-4fd9-9761-f996ffb07009 tempest-AttachVolumeNegativeTest-389404715 None] Created volume successfully.
Sep 09 13:21:05 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:05 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:05 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.476s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:05 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e 1G
Sep 09 13:21:05 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:06 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e 1G" returned: 0 in 0.694s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:06 devstack sudo[97846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:06 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:06 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:06 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e is being set with open permissions: ugo+rw
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:06 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:06 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-66ea1991-d465-4b24-99f5-113b38c7ffad req-de037523-3363-495f-9798-54e55d6ed6e6 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:06 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.324s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-66ea1991-d465-4b24-99f5-113b38c7ffad req-de037523-3363-495f-9798-54e55d6ed6e6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.121s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-66ea1991-d465-4b24-99f5-113b38c7ffad req-de037523-3363-495f-9798-54e55d6ed6e6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f7fb3e4b-ee0d-40eb-b06e-6deabdbd6dd7 tempest-VolumesDeleteCascade-1445845252 None] Create snapshot completed successfully
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-66ea1991-d465-4b24-99f5-113b38c7ffad req-de037523-3363-495f-9798-54e55d6ed6e6 tempest-AttachVolumeNegativeTest-389404715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-05e3f286-08bf-44e2-9484-8d41cd5905ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd70f5d89-4cbc-4850-a6a0-ce86a71b471c', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:21:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-66ea1991-d465-4b24-99f5-113b38c7ffad req-de037523-3363-495f-9798-54e55d6ed6e6 tempest-AttachVolumeNegativeTest-389404715 None] attachment_update completed successfully.
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Performing cascade delete. {{(pid=87606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-0b70397a-8760-4c28-a85e-a2c081553eda-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-0b70397a-8760-4c28-a85e-a2c081553eda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-0b70397a-8760-4c28-a85e-a2c081553eda" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-0b70397a-8760-4c28-a85e-a2c081553eda" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Deleting offline snapshot 0b70397a-8760-4c28-a85e-a2c081553eda of volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] snapshot_file for this snap is: volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba31cd-1a98-4eb0-bc50-1659d3adff81]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:07 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:07 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Flow 'volume_create_manager' (b24da6a9-8829-49e4-93f6-d70a5514ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcd1a42-cc83-4c9a-991e-c060f13a88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcd1a42-cc83-4c9a-991e-c060f13a88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-828380327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2d7958-70d6-4b35-9e68-e85092a8ce3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d148fb4ac1ec424e8b968f3c4d08f1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:08Z,use_quota=True,user_id='04a32f5e26124aa8a5e4b9d86912bba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7e544-bb43-4f79-a101-6287955f18bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7e544-bb43-4f79-a101-6287955f18bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126b961-d847-4024-aeeb-59c8a89be3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126b961-d847-4024-aeeb-59c8a89be3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2d7958-70d6-4b35-9e68-e85092a8ce3a', 'volume_name': 'volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3f611b-fa61-4b32-989d-608cec0a53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3f611b-fa61-4b32-989d-608cec0a53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bc6085-9a48-48cf-adbf-26ea6f16468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:08 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Volume be2d7958-70d6-4b35-9e68-e85092a8ce3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a', 'volume_size': 1}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-828380327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2d7958-70d6-4b35-9e68-e85092a8ce3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d148fb4ac1ec424e8b968f3c4d08f1e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:08Z,use_quota=True,user_id='04a32f5e26124aa8a5e4b9d86912bba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Creating volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:08 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:08 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.772s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:08 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a 1073741824
Sep 09 13:21:08 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5722d08-483e-41a9-801a-153ee4c9c28d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:08 devstack sudo[98252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:08 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:09 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.558s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:09 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a 1073741824" returned: 0 in 0.694s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0afeef-5479-4968-af00-efc4675e4607]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:09 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a
Sep 09 13:21:09 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:09 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:09 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:09 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bc6085-9a48-48cf-adbf-26ea6f16468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c199bb-0474-40e8-a10c-daba5e907ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Volume volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a (be2d7958-70d6-4b35-9e68-e85092a8ce3a): created successfully
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c199bb-0474-40e8-a10c-daba5e907ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:09 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Flow 'volume_create_manager' (b24da6a9-8829-49e4-93f6-d70a5514ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.456s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6faa97ae-bd67-4934-9e73-c0dedd899a62 tempest-VolumesSnapshotListTestJSON-1086336295 None] Created volume successfully.
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfff2e5-554d-46df-9f96-007d9aed606c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:09 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:09 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-b75ca638-2fcc-4102-bb15-98651d74003b req-1f6a455d-5c51-4723-aee4-5d950b45a883 tempest-AttachVolumeNegativeTest-389404715 None] Terminate volume connection completed successfully.
Sep 09 13:21:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-b75ca638-2fcc-4102-bb15-98651d74003b req-1f6a455d-5c51-4723-aee4-5d950b45a883 tempest-AttachVolumeNegativeTest-389404715 None] Deleting attachment d70f5d89-4cbc-4850-a6a0-ce86a71b471c. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:21:10 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.461s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5486e-ad1c-48b7-b178-76b6be92290e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:10 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:10 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Creating offline snapshot 54a384ac-40c0-4619-a448-9043fc8d1a08 of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec0f483-5804-41cc-ad55-fbacc7aa34bd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:10 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.434s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:10 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a
Sep 09 13:21:10 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:10 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:10 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:10 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a" returned: 0 in 0.499s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:11 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 1G
Sep 09 13:21:11 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:11 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:11 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda
Sep 09 13:21:11 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:11 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.0b70397a-8760-4c28-a85e-a2c081553eda" returned: 0 in 0.413s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e -F qcow2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:11 devstack sudo[98339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e -F qcow2
Sep 09 13:21:11 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:11 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 1G" returned: 0 in 0.814s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:11 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:11 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:12 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e -F qcow2" returned: 0 in 0.577s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-0b70397a-8760-4c28-a85e-a2c081553eda" released by "_delete_snapshot" :: held 4.495s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" released by "delete_snapshot" :: held 4.534s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:12 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 0.467s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:12 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 is being set with open permissions: ugo+rw
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['d20607a3-30d0-441e-9cf3-44062427d003', '0c8ded18-d420-4f2a-9832-776f6381ba5c', '8c2c3e49-0ff7-45e9-a09b-fd998015dba9', '1752d48f-1e0c-4def-a5f3-278363a09e00'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:12 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:12 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Delete snapshot completed successfully.
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-0b70397a-8760-4c28-a85e-a2c081553eda-delete_snapshot" released by "delete_snapshot" :: held 4.777s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-9a48036d-3e58-483e-b9cd-20d69ebfe72e-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-9a48036d-3e58-483e-b9cd-20d69ebfe72e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-9a48036d-3e58-483e-b9cd-20d69ebfe72e" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-9a48036d-3e58-483e-b9cd-20d69ebfe72e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Deleting offline snapshot 9a48036d-3e58-483e-b9cd-20d69ebfe72e of volume 6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] snapshot_file for this snap is: volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee2410d-b460-496c-b207-e80fbafd94a3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:12 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:12 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:12 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:12 devstack sudo[98368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info
Sep 09 13:21:12 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:13 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info" returned: 0 in 0.410s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:13 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info is being set with open permissions: ugo+rw
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:13 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.607s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:13 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info
Sep 09 13:21:13 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370f4c2-8285-4e62-a11d-b393a311318a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:13 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:13 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:13 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.info" returned: 0 in 0.308s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.034s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c87dbf68-2403-4141-a390-c28610bb3c8c tempest-VolumesSnapshotListTestJSON-1086336295 None] Create snapshot completed successfully
Sep 09 13:21:13 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.484s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:13 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:13 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Creating offline snapshot c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbd812-ed78-4b6d-b66d-ad8b2240e980]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:14 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.477s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:14 devstack sudo[98390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:14 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:14 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e
Sep 09 13:21:14 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:14 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9.9a48036d-3e58-483e-b9cd-20d69ebfe72e" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:14 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 0.503s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-9a48036d-3e58-483e-b9cd-20d69ebfe72e" released by "_delete_snapshot" :: held 2.067s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" released by "delete_snapshot" :: held 2.102s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:14 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 1G
Sep 09 13:21:14 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['ee930ec3-c330-43e0-a31e-0ba758d3c008', '7d3433ff-893c-496e-b631-b2d2c9b24976', '69e8b363-3ddb-40da-8140-ed27af5145f3', 'a62c7991-ba3f-4d8e-8d90-56bd96640f7c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Delete snapshot completed successfully.
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-9a48036d-3e58-483e-b9cd-20d69ebfe72e-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Snapshots deleted, issuing volume delete {{(pid=87606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9133dec8-120b-428b-a995-7c9df889e6d7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:14 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:14 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:15 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 1G" returned: 0 in 0.650s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:15 devstack sudo[98407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:15 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:15 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:15 devstack sudo[98412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9
Sep 09 13:21:15 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:15 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.430s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:15 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 is being set with open permissions: ugo+rw
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:15 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:15 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:15 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" returned: 0 in 0.330s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9" released by "delete_volume" :: held 0.930s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['8bfa6e07-41ad-44ee-b741-8df751a76aae', 'f0a86669-d3cc-45bd-b0a4-7da23b51b55b', 'ebc44993-518d-4d61-a354-881d4b305957', '9e841215-9539-4455-bb6a-fe0624dbb754'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:15 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:15 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:15 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a16b0641-8b96-49b9-b521-6fb1cfa47881 tempest-VolumesSnapshotListTestJSON-1086336295 None] Create snapshot completed successfully
Sep 09 13:21:16 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.339s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:16 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Deleted volume successfully.
Sep 09 13:21:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-45724fc6-2b36-45a3-8fa4-9fbf6fc54928 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-6ea97529-4ab3-4cc0-b72f-b60dc827dcd9-delete_volume" released by "delete_volume" :: held 8.776s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Creating offline snapshot 5c8a94aa-0071-4f0a-a959-0dabc12f724a of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d147991-a2b7-4f90-b8d9-8222738280ab]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:17 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:17 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (cbd1b895-7890-4257-bd89-8b411fa2b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44f9550-1224-436f-9ce5-a20fae17e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44f9550-1224-436f-9ce5-a20fae17e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-674587861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a19f9f-1c0b-426c-a26c-7299472e81fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85421c0abcff41938f316ce46686bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:18Z,use_quota=True,user_id='287e79ed59954764b8f85d710d90786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ecb4a6-3c20-4983-b82a-a7039d4ca54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ecb4a6-3c20-4983-b82a-a7039d4ca54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db57bb9-12fc-4474-a640-1730071c3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db57bb9-12fc-4474-a640-1730071c3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a19f9f-1c0b-426c-a26c-7299472e81fb', 'volume_name': 'volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75381a4-e163-42a5-a52e-85e9c7b376e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75381a4-e163-42a5-a52e-85e9c7b376e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4cacfc-3f1f-43fa-86fd-421bac8dd6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Volume e2a19f9f-1c0b-426c-a26c-7299472e81fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb', 'volume_size': 1}
Sep 09 13:21:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:18 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.489s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:18 devstack sudo[98466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a 1G
Sep 09 13:21:18 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:18 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a 1G" returned: 0 in 0.617s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:18 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a
Sep 09 13:21:18 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:18 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:18 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a is being set with open permissions: ugo+rw
Sep 09 13:21:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:19 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a
Sep 09 13:21:19 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:19 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a" returned: 0 in 0.286s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-674587861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a19f9f-1c0b-426c-a26c-7299472e81fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85421c0abcff41938f316ce46686bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:18Z,use_quota=True,user_id='287e79ed59954764b8f85d710d90786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Creating volume e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:19 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:19 devstack sudo[98481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb 1073741824
Sep 09 13:21:19 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-dbb24e8d-3009-4d61-87c2-4914f0b9c2b9 tempest-VolumesSnapshotListTestJSON-1086336295 None] Create snapshot completed successfully
Sep 09 13:21:20 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb 1073741824" returned: 0 in 0.713s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:20 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:20 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:20 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4cacfc-3f1f-43fa-86fd-421bac8dd6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989b3212-142b-48df-a0f1-775c4bc2968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Volume volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb (e2a19f9f-1c0b-426c-a26c-7299472e81fb): created successfully
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989b3212-142b-48df-a0f1-775c4bc2968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (cbd1b895-7890-4257-bd89-8b411fa2b259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-648afa1a-2de2-4ccf-aa0e-5cc6242d444c tempest-VolumesDeleteCascade-1445845252 None] Created volume successfully.
Sep 09 13:21:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-5c8a94aa-0071-4f0a-a959-0dabc12f724a-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-5c8a94aa-0071-4f0a-a959-0dabc12f724a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-5c8a94aa-0071-4f0a-a959-0dabc12f724a" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-5c8a94aa-0071-4f0a-a959-0dabc12f724a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Deleting offline snapshot 5c8a94aa-0071-4f0a-a959-0dabc12f724a of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] snapshot_file for this snap is: volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b2e43-ca81-4007-89e5-097127e9494b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Creating offline snapshot 14d70a91-c9aa-451f-ac31-c7a75d5b3c36 of volume e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe58be4-82a4-4ad2-b0c5-4656fb285da0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:21 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a
Sep 09 13:21:21 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:21 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:21 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:21 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a" returned: 0 in 0.604s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:21 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.550s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec5105-d76c-4168-973d-9bd1c34659d0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:21 devstack sudo[98501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 1G
Sep 09 13:21:21 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:22 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:22 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:22 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.618s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:22 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a
Sep 09 13:21:22 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:22 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 1G" returned: 0 in 0.755s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:22 devstack sudo[98517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:22 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:22 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.411s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:23 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 is being set with open permissions: ugo+rw
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:23 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a" returned: 0 in 0.558s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:23 devstack sudo[98526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:23 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:23 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a
Sep 09 13:21:23 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:23 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.364s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:23 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.5c8a94aa-0071-4f0a-a959-0dabc12f724a" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-5c8a94aa-0071-4f0a-a959-0dabc12f724a" released by "_delete_snapshot" :: held 2.349s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" released by "delete_snapshot" :: held 2.389s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:23 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info
Sep 09 13:21:23 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Created reservations ['ffb8e4f8-880c-44e5-a4bf-9e46c9e896ce', '05e9aeba-19ea-4234-9bac-e324041145c5', '8fd6e990-3c0e-4b45-9918-c22a649cb77a', 'd767304e-2c61-4797-b9ae-74f766f0eb7a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:23 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Delete snapshot completed successfully.
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cf160db8-5e57-4360-a4e0-2f7cc6433c4c tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-5c8a94aa-0071-4f0a-a959-0dabc12f724a-delete_snapshot" released by "delete_snapshot" :: held 2.607s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:23 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:23 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info is being set with open permissions: ugo+rw
Sep 09 13:21:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:23 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info
Sep 09 13:21:23 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:24 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.info" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9a804218-2764-4171-8730-0248471d3709 tempest-VolumesDeleteCascade-1445845252 None] Create snapshot completed successfully
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Deleting offline snapshot c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] snapshot_file for this snap is: volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb3314-50b2-4910-af7e-0e3ea221b161]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:24 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:24 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:25 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.703s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06db88d-ef8c-43f3-96a9-fa3a28cd7741]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:25 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:25 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:25 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:25 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (71399147-9cfd-40c8-a3d1-05132fe69872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e3cc71-bd3c-430f-b401-1f5a910d5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e3cc71-bd3c-430f-b401-1f5a910d5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1673905487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19a730e-68bc-48d9-b4bd-b71df411ddbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85421c0abcff41938f316ce46686bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14d70a91-c9aa-451f-ac31-c7a75d5b3c36,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:25Z,use_quota=True,user_id='287e79ed59954764b8f85d710d90786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874d5ddd-5c57-4260-bd8b-9f3fdc8f5785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874d5ddd-5c57-4260-bd8b-9f3fdc8f5785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cfcda-48da-4ee6-9111-cd8def0e78ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1cfcda-48da-4ee6-9111-cd8def0e78ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b19a730e-68bc-48d9-b4bd-b71df411ddbc', 'volume_name': 'volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc', 'volume_size': 1, 'snapshot_id': '14d70a91-c9aa-451f-ac31-c7a75d5b3c36'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327a1a54-2fb6-4707-9b62-15fd27fbaa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327a1a54-2fb6-4707-9b62-15fd27fbaa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e65e37b-fa56-4666-9a68-0b77a4fa475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Volume b19a730e-68bc-48d9-b4bd-b71df411ddbc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc', 'volume_size': 1, 'snapshot_id': '14d70a91-c9aa-451f-ac31-c7a75d5b3c36'}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-b19a730e-68bc-48d9-b4bd-b71df411ddbc" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-b19a730e-68bc-48d9-b4bd-b71df411ddbc" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Creating volume b19a730e-68bc-48d9-b4bd-b71df411ddbc from snapshot 14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] snapshot: 14d70a91-c9aa-451f-ac31-c7a75d5b3c36, volume: b19a730e-68bc-48d9-b4bd-b71df411ddbc,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:25 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 0.624s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:25 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a844695-b55b-45dd-a228-0343f45ffa8b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:25 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:25 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.567s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:21:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:21:26 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:26 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:26 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.538s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2b12cc-79e2-48d9-bf1a-ca2753e65498]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:26 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.630s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:26 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2
Sep 09 13:21:26 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:26 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:26 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:26 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" returned: 0 in 0.372s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2" released by "_delete_snapshot" :: held 2.518s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" released by "delete_snapshot" :: held 2.554s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:27 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.584s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Created reservations ['7d33e57b-b4da-427b-966f-e5273dfed436', '13add267-cd93-413b-860c-1be681f121ca', 'e055bb96-8246-42de-803f-d515ca76182d', 'd93dd220-5948-454a-b774-d5a94b606ef1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:27 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc
Sep 09 13:21:27 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Delete snapshot completed successfully.
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c1df529e-3b07-4980-8c54-80c5ca2b9006 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-c8e63de3-f649-4ff5-b1c9-3a206d04f9a2-delete_snapshot" released by "delete_snapshot" :: held 2.864s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-54a384ac-40c0-4619-a448-9043fc8d1a08-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-54a384ac-40c0-4619-a448-9043fc8d1a08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-54a384ac-40c0-4619-a448-9043fc8d1a08" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-54a384ac-40c0-4619-a448-9043fc8d1a08" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Deleting offline snapshot 54a384ac-40c0-4619-a448-9043fc8d1a08 of volume be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] snapshot_file for this snap is: volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6f9cc-9682-4fd9-8afc-8d5d414e5e37]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:28 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:28 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:29 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 1.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:29 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa3db71-518c-4713-8449-e66af0db98e6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:29 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a
Sep 09 13:21:29 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:30 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a" returned: 0 in 1.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:30 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:30 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:31 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 1.454s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:32 devstack sudo[98697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08
Sep 09 13:21:32 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:32 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a.54a384ac-40c0-4619-a448-9043fc8d1a08" returned: 0 in 0.968s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-54a384ac-40c0-4619-a448-9043fc8d1a08" released by "_delete_snapshot" :: held 5.425s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" released by "delete_snapshot" :: held 5.488s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Created reservations ['eca28deb-e018-4d76-8570-4fed16c0ca14', '221ee94c-c114-4503-97ea-fcc2b7626948', '3091ca85-b264-4ac9-9ec9-6bdbe647d22e', '7d92e068-7cf6-4b41-a7ff-3e965c99da6c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Delete snapshot completed successfully.
Sep 09 13:21:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6415550d-05bd-4c7f-abda-5340d5d9ffe6 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-54a384ac-40c0-4619-a448-9043fc8d1a08-delete_snapshot" released by "delete_snapshot" :: held 6.015s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-be2d7958-70d6-4b35-9e68-e85092a8ce3a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-be2d7958-70d6-4b35-9e68-e85092a8ce3a-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" acquired by "delete_volume" :: waited 0.054s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[39660c12-6458-407c-9cd9-22745f664172]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:35 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a
Sep 09 13:21:35 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:36 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc" returned: 0 in 9.414s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:36 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb, size 1024.00 MB, duration 9.42 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:21:36 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Converted 1024.00 MB image at 108.76 MB/s
Sep 09 13:21:36 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc is being set with open permissions: ugo+rw
Sep 09 13:21:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:36 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc
Sep 09 13:21:36 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:36 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a" returned: 0 in 1.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:36 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a
Sep 09 13:21:36 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:37 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc" returned: 0 in 0.544s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" released by "_copy_volume_from_snapshot" :: held 11.221s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-b19a730e-68bc-48d9-b4bd-b71df411ddbc" released by "_create_volume_from_snapshot" :: held 11.348s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.370s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e65e37b-fa56-4666-9a68-0b77a4fa475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc', 'volume_size': 1, 'snapshot_id': '14d70a91-c9aa-451f-ac31-c7a75d5b3c36'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23759-9e6c-4768-a536-256e4a6729df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:37 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Volume volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc (b19a730e-68bc-48d9-b4bd-b71df411ddbc): created successfully
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23759-9e6c-4768-a536-256e4a6729df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Flow 'volume_create_manager' (71399147-9cfd-40c8-a3d1-05132fe69872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5fcc8741-4cb5-46e9-a59c-af94d4a01747 tempest-VolumesDeleteCascade-1445845252 None] Created volume successfully.
Sep 09 13:21:37 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-be2d7958-70d6-4b35-9e68-e85092a8ce3a" returned: 0 in 0.559s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-quobyte-be2d7958-70d6-4b35-9e68-e85092a8ce3a" released by "delete_volume" :: held 2.030s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:37 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Created reservations ['d2a09f84-c484-4e4c-90bb-ac307a519b3c', 'a75ff7d3-504e-4098-a88b-e48dc5e4d516', 'e73c8f66-fae8-4c90-8f49-ec79b09e6f24', '459dc2ba-c7ea-4c6c-a022-d7583979ec8c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-e2a19f9f-1c0b-426c-a26c-7299472e81fb-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-e2a19f9f-1c0b-426c-a26c-7299472e81fb-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:38 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:38 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Performing cascade delete. {{(pid=87606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Deleting offline snapshot 14d70a91-c9aa-451f-ac31-c7a75d5b3c36 of volume e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] snapshot_file for this snap is: volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0f1b3-ead3-41f9-bb86-767418e90197]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:38 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.617s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Deleted volume successfully.
Sep 09 13:21:38 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:38 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f24861c6-d09c-48aa-b610-ed171d882dd4 tempest-VolumesSnapshotListTestJSON-1086336295 None] Lock "cinder-be2d7958-70d6-4b35-9e68-e85092a8ce3a-delete_volume" released by "delete_volume" :: held 3.672s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:39 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.938s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041fd21-6c68-4b5a-b851-94bedc41042a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:39 devstack sudo[98763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:39 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:40 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.850s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:40 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:40 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:40 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.500s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:40 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36
Sep 09 13:21:40 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:41 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb.14d70a91-c9aa-451f-ac31-c7a75d5b3c36" returned: 0 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-14d70a91-c9aa-451f-ac31-c7a75d5b3c36" released by "_delete_snapshot" :: held 2.864s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" released by "delete_snapshot" :: held 2.918s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=110,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=6 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=109,cinder:INSERT=37,cinder:UPDATE=98,cinder:DELETE=12 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['b0f1280c-87fb-43d5-a93f-1cf0b1583824', '3fe9e4c2-4cf6-4845-af0b-80f7913f21ff', '765e5b55-bcd0-4428-9861-5b3a4d50c7a8', '3ffcf788-79b8-4153-a0a3-6d36e8ad49be'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Delete snapshot completed successfully.
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-14d70a91-c9aa-451f-ac31-c7a75d5b3c36-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Snapshots deleted, issuing volume delete {{(pid=87606) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" acquired by "delete_volume" :: waited 0.073s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd1dbd-200a-4199-aa1d-c797925cd34d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:42 devstack sudo[98816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:42 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:42 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.726s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:42 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb
Sep 09 13:21:42 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:43 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2a19f9f-1c0b-426c-a26c-7299472e81fb" returned: 0 in 0.661s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-e2a19f9f-1c0b-426c-a26c-7299472e81fb" released by "delete_volume" :: held 1.621s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['39f7adc8-8506-467b-8be9-32167ea88968', '7d8fc46c-3e23-4c55-b5b2-e002c2602066', '98754223-4f57-4f8b-a008-d32e1846eb7e', '1d1ce076-8715-4977-8e21-06769d16e735'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:43 devstack sudo[98872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:43 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-b19a730e-68bc-48d9-b4bd-b71df411ddbc-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:44 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-b19a730e-68bc-48d9-b4bd-b71df411ddbc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.668s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Deleted volume successfully.
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-181389ba-8d43-4e72-a128-396aa184820d tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-e2a19f9f-1c0b-426c-a26c-7299472e81fb-delete_volume" released by "delete_volume" :: held 6.271s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf2c129-695b-4cbc-862d-fe5ac94e8302]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:44 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc
Sep 09 13:21:44 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:45 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc" returned: 0 in 0.448s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:45 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc
Sep 09 13:21:45 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:45 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b19a730e-68bc-48d9-b4bd-b71df411ddbc" returned: 0 in 0.303s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-quobyte-b19a730e-68bc-48d9-b4bd-b71df411ddbc" released by "delete_volume" :: held 0.857s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Created reservations ['07a0e953-cdd0-4b3d-bb91-dab9cb68e34f', 'e5a21d71-5894-4527-95d9-2a8cee20c327', '246b8765-1fa1-4424-9fdf-210fdb2e5257', '038c4b9c-70a6-4162-ad93-ba9c45b05587'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:45 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:45 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:45 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.292s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Deleted volume successfully.
Sep 09 13:21:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-aeb62a68-1580-4277-9090-9e3dd5231830 tempest-VolumesDeleteCascade-1445845252 None] Lock "cinder-b19a730e-68bc-48d9-b4bd-b71df411ddbc-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Flow 'volume_create_manager' (4bda4a6a-541a-459a-a6a6-9ed3017e0c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c1ef44-447c-428c-848f-36f0ac5ec92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c1ef44-447c-428c-848f-36f0ac5ec92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-626949216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5db5d9-b945-407a-aab2-a332e5a6c203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab535a148bb54ba1896a260dab71ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:46Z,use_quota=True,user_id='5819da347dde4d78ac1db813762729f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12795f94-be9a-4f1a-8393-18c34dd8562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12795f94-be9a-4f1a-8393-18c34dd8562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099c8dd5-6c6a-4933-a31e-8abd88de39c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099c8dd5-6c6a-4933-a31e-8abd88de39c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5db5d9-b945-407a-aab2-a332e5a6c203', 'volume_name': 'volume-af5db5d9-b945-407a-aab2-a332e5a6c203', 'volume_size': 2}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643d74ea-28be-4a1d-9f54-43ee0c75f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643d74ea-28be-4a1d-9f54-43ee0c75f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff20dab-2db5-402e-9bf7-220752051e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Volume af5db5d9-b945-407a-aab2-a332e5a6c203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5db5d9-b945-407a-aab2-a332e5a6c203', 'volume_size': 2}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-626949216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5db5d9-b945-407a-aab2-a332e5a6c203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab535a148bb54ba1896a260dab71ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:46Z,use_quota=True,user_id='5819da347dde4d78ac1db813762729f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Creating volume af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:46 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 2147483648 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:46 devstack sudo[98888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 2147483648
Sep 09 13:21:46 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:47 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 2147483648" returned: 0 in 0.662s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:47 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203
Sep 09 13:21:47 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:47 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff20dab-2db5-402e-9bf7-220752051e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5db5d9-b945-407a-aab2-a332e5a6c203', 'volume_size': 2}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffc4b0f-af31-4c97-ad10-ec31c50e727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Volume volume-af5db5d9-b945-407a-aab2-a332e5a6c203 (af5db5d9-b945-407a-aab2-a332e5a6c203): created successfully
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffc4b0f-af31-4c97-ad10-ec31c50e727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Flow 'volume_create_manager' (4bda4a6a-541a-459a-a6a6-9ed3017e0c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Flow 'volume_create_manager' (e1eaffad-1f6e-41be-bfae-8a4b81357b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74f55a5-4455-4acb-a041-94cdef427d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5db7c764-3c02-4762-8d2e-590ec923884a tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Created volume successfully.
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74f55a5-4455-4acb-a041-94cdef427d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1146908263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d831ab7f-9302-46e3-8bae-6cefaf493dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9bd91b82d54543b797e29cf0086a6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:48Z,use_quota=True,user_id='5e742e0d2f1848be8fc30ac77a7b0f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c38001c-e182-4c47-9fbb-57d505610362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c38001c-e182-4c47-9fbb-57d505610362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70fa3e1-2aa9-4a1b-90e8-9ceec620f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70fa3e1-2aa9-4a1b-90e8-9ceec620f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd831ab7f-9302-46e3-8bae-6cefaf493dab', 'volume_name': 'volume-d831ab7f-9302-46e3-8bae-6cefaf493dab', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296125bc-479e-4654-b255-b487a9417e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296125bc-479e-4654-b255-b487a9417e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e68888-bc2a-44f1-aa87-35e9a06906fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Volume d831ab7f-9302-46e3-8bae-6cefaf493dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d831ab7f-9302-46e3-8bae-6cefaf493dab', 'volume_size': 1}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1146908263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d831ab7f-9302-46e3-8bae-6cefaf493dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9bd91b82d54543b797e29cf0086a6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:48Z,use_quota=True,user_id='5e742e0d2f1848be8fc30ac77a7b0f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Creating volume d831ab7f-9302-46e3-8bae-6cefaf493dab {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:47 devstack sudo[98897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab 1073741824
Sep 09 13:21:47 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:48 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab 1073741824" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:48 devstack sudo[98903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab
Sep 09 13:21:48 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:48 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e68888-bc2a-44f1-aa87-35e9a06906fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d831ab7f-9302-46e3-8bae-6cefaf493dab', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252d6fd-ebb2-45eb-8506-5c2322442860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Volume volume-d831ab7f-9302-46e3-8bae-6cefaf493dab (d831ab7f-9302-46e3-8bae-6cefaf493dab): created successfully
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252d6fd-ebb2-45eb-8506-5c2322442860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Flow 'volume_create_manager' (e1eaffad-1f6e-41be-bfae-8a4b81357b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2e221c80-b011-462c-9d8a-1b6c0ac065a3 tempest-TestMinimumBasicScenario-535353943 None] Created volume successfully.
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Creating offline snapshot af2281a0-e237-4069-b05e-f2647efb056a of volume af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebda0f8e-f4d0-4e6d-85be-d82109b5401b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:49 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203
Sep 09 13:21:49 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:49 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203" returned: 0 in 0.390s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a 2G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:49 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a 2G
Sep 09 13:21:49 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:49 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a 2G" returned: 0 in 0.502s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5db5d9-b945-407a-aab2-a332e5a6c203 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:49 devstack sudo[98918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5db5d9-b945-407a-aab2-a332e5a6c203 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a
Sep 09 13:21:49 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:50 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5db5d9-b945-407a-aab2-a332e5a6c203 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a" returned: 0 in 0.459s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:50 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a is being set with open permissions: ugo+rw
Sep 09 13:21:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:50 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a
Sep 09 13:21:50 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:50 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a" returned: 0 in 0.378s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:50 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info
Sep 09 13:21:50 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:51 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info" returned: 0 in 0.413s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:51 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info is being set with open permissions: ugo+rw
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:51 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info
Sep 09 13:21:51 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:51 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.info" returned: 0 in 0.433s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d5883388-16f5-4825-aab5-fbeea889bb16 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Create snapshot completed successfully
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21dd3bc2-ddab-400c-8eb6-371e8ac22ac6 req-2a05e1e2-5023-4f25-9dd5-fab95b5393e3 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21dd3bc2-ddab-400c-8eb6-371e8ac22ac6 req-2a05e1e2-5023-4f25-9dd5-fab95b5393e3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-21dd3bc2-ddab-400c-8eb6-371e8ac22ac6 req-2a05e1e2-5023-4f25-9dd5-fab95b5393e3 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-21dd3bc2-ddab-400c-8eb6-371e8ac22ac6 req-2a05e1e2-5023-4f25-9dd5-fab95b5393e3 tempest-TestMinimumBasicScenario-535353943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-d831ab7f-9302-46e3-8bae-6cefaf493dab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab20203b-98b8-47be-a0b1-038d4ff8b277', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:21:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-21dd3bc2-ddab-400c-8eb6-371e8ac22ac6 req-2a05e1e2-5023-4f25-9dd5-fab95b5393e3 tempest-TestMinimumBasicScenario-535353943 None] attachment_update completed successfully.
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "cinder-af2281a0-e237-4069-b05e-f2647efb056a-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-af2281a0-e237-4069-b05e-f2647efb056a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "cinder-quobyte-af2281a0-e237-4069-b05e-f2647efb056a" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af2281a0-e237-4069-b05e-f2647efb056a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Deleting offline snapshot af2281a0-e237-4069-b05e-f2647efb056a of volume af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] snapshot_file for this snap is: volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dffc13-ac52-4913-ba26-fd9aa56eb524]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:52 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a
Sep 09 13:21:52 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:53 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a" returned: 0 in 0.558s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af5db5d9-b945-407a-aab2-a332e5a6c203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:21:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[24712c28-f4d7-4966-af70-7fe27b86080a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:53 devstack sudo[99333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203
Sep 09 13:21:53 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:53 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203" returned: 0 in 0.824s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:54 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a
Sep 09 13:21:54 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (d65593fa-8be5-49c2-9e7b-4d88ccc6331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2351774a-b289-4f76-bcb6-d3c0019de6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2351774a-b289-4f76-bcb6-d3c0019de6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1971158890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e07c7-66c3-4643-bddc-b0d024bd6cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:54Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0557f2-4215-4135-84ac-3657ae5fdf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0557f2-4215-4135-84ac-3657ae5fdf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe32a9-e1d2-43d7-93b6-811ac82cbd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe32a9-e1d2-43d7-93b6-811ac82cbd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04e07c7-66c3-4643-bddc-b0d024bd6cfd', 'volume_name': 'volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882fe4e7-be00-4fc2-b30d-4650a605d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882fe4e7-be00-4fc2-b30d-4650a605d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030cf928-1345-439a-a20f-fe09e719d886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Volume a04e07c7-66c3-4643-bddc-b0d024bd6cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd', 'volume_size': 1}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1971158890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e07c7-66c3-4643-bddc-b0d024bd6cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbbd6a610a54626bfbba9f643014451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:54Z,use_quota=True,user_id='2c2648642545442d843b822b839e67e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Creating volume a04e07c7-66c3-4643-bddc-b0d024bd6cfd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:54 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:54 devstack sudo[99341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd 1073741824
Sep 09 13:21:54 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Flow 'volume_create_manager' (4aceb941-96d5-45d0-b084-8823a827ed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffe2943-a70a-4af7-b527-cf8e45ee7415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffe2943-a70a-4af7-b527-cf8e45ee7415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074433795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59aa0465-ea6e-467f-8193-675764d8d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdc456c22ae40c589d6ce05d5dd7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:54Z,use_quota=True,user_id='4e7f1ddf550241beb39c9d3640d4e846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b8ef3f-1049-4e15-8001-76df7d7ee0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b8ef3f-1049-4e15-8001-76df7d7ee0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d066ba9-0ef4-419c-8d43-eb763d8b5e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d066ba9-0ef4-419c-8d43-eb763d8b5e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59aa0465-ea6e-467f-8193-675764d8d2bd', 'volume_name': 'volume-59aa0465-ea6e-467f-8193-675764d8d2bd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4681b49d-e0c2-451f-9243-638abe0c26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4681b49d-e0c2-451f-9243-638abe0c26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e69e1e7-1673-4362-b48f-490438654e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Volume 59aa0465-ea6e-467f-8193-675764d8d2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59aa0465-ea6e-467f-8193-675764d8d2bd', 'volume_size': 1}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a" returned: 0 in 0.600s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:54 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a
Sep 09 13:21:54 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:54 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203.af2281a0-e237-4069-b05e-f2647efb056a" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:54 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd 1073741824" returned: 0 in 0.765s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af2281a0-e237-4069-b05e-f2647efb056a" released by "_delete_snapshot" :: held 2.586s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" released by "delete_snapshot" :: held 2.639s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:55 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd
Sep 09 13:21:55 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Created reservations ['953a3fe9-caf7-4191-a860-4df2fd79eca6', 'df9d4048-4b79-4921-980b-be1a3d86a547', '03145b7a-05a3-4a2b-98c9-586636a0997a', '7413e259-9b2f-4aa5-b62e-c696061b657e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Delete snapshot completed successfully.
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2d40fe8b-e7dc-4691-a0fa-c621c92bc7d7 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-af2281a0-e237-4069-b05e-f2647efb056a-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:55 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074433795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59aa0465-ea6e-467f-8193-675764d8d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdc456c22ae40c589d6ce05d5dd7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:21:54Z,use_quota=True,user_id='4e7f1ddf550241beb39c9d3640d4e846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Creating volume 59aa0465-ea6e-467f-8193-675764d8d2bd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:21:55 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030cf928-1345-439a-a20f-fe09e719d886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def47ff5-971a-43da-a546-441509bd709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:55 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd 1073741824
Sep 09 13:21:55 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Volume volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd (a04e07c7-66c3-4643-bddc-b0d024bd6cfd): created successfully
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def47ff5-971a-43da-a546-441509bd709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Flow 'volume_create_manager' (d65593fa-8be5-49c2-9e7b-4d88ccc6331f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-be2d39f1-6dde-422b-9578-bc8d8ac80800 tempest-AttachVolumeNegativeTest-389404715 None] Created volume successfully.
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "cinder-af5db5d9-b945-407a-aab2-a332e5a6c203-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-af5db5d9-b945-407a-aab2-a332e5a6c203-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:56 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd 1073741824" returned: 0 in 0.660s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f11868-b82f-41e9-929f-d919edec3d6d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:56 devstack sudo[99363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd
Sep 09 13:21:56 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:56 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203
Sep 09 13:21:56 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:56 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd" returned: 0 in 0.373s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e69e1e7-1673-4362-b48f-490438654e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59aa0465-ea6e-467f-8193-675764d8d2bd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5de98-9bc3-43c5-b3a9-cd24bd508cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:21:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Volume volume-59aa0465-ea6e-467f-8193-675764d8d2bd (59aa0465-ea6e-467f-8193-675764d8d2bd): created successfully
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5de98-9bc3-43c5-b3a9-cd24bd508cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Flow 'volume_create_manager' (4aceb941-96d5-45d0-b084-8823a827ed76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:21:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f049410f-d3eb-4f00-941c-9113d8ddc870 tempest-VolumesTransfersV355Test-485869874 None] Created volume successfully.
Sep 09 13:21:56 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203" returned: 0 in 0.616s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:56 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203
Sep 09 13:21:56 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:57 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af5db5d9-b945-407a-aab2-a332e5a6c203" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-quobyte-af5db5d9-b945-407a-aab2-a332e5a6c203" released by "delete_volume" :: held 1.085s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Created reservations ['066dee3c-9af0-4677-82e6-3cb5773d4db8', 'd09107f9-1be6-457b-a819-8af649fc708c', '7affd6ab-30b6-4127-bca4-98308ea4e26c', 'c7492deb-f05a-4c2f-93a4-a20de97de808'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:57 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:21:57 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5a76bc68-e8db-44a7-a80f-db8cf3e160fd req-29d6c5b6-6156-4124-9b80-1d2774b377f3 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5a76bc68-e8db-44a7-a80f-db8cf3e160fd req-29d6c5b6-6156-4124-9b80-1d2774b377f3 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-5a76bc68-e8db-44a7-a80f-db8cf3e160fd req-29d6c5b6-6156-4124-9b80-1d2774b377f3 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-5a76bc68-e8db-44a7-a80f-db8cf3e160fd req-29d6c5b6-6156-4124-9b80-1d2774b377f3 tempest-AttachVolumeNegativeTest-389404715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '794f22b4-33f8-49e5-9ba5-df7316e1d7aa', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:21:57 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:21:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Deleted volume successfully.
Sep 09 13:21:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b59234bd-14e3-427a-8d3a-ab8151ea2035 tempest-VolumesSnapshotNegativeTestJSON-8444668 None] Lock "cinder-af5db5d9-b945-407a-aab2-a332e5a6c203-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:21:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-5a76bc68-e8db-44a7-a80f-db8cf3e160fd req-29d6c5b6-6156-4124-9b80-1d2774b377f3 tempest-AttachVolumeNegativeTest-389404715 None] attachment_update completed successfully.
Sep 09 13:21:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5d7c8ecc-5fec-46a0-bb7e-9e628bf4d21b tempest-VolumesTransfersV355Test-342825006 None] Transfer volume completed successfully.
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "cinder-59aa0465-ea6e-467f-8193-675764d8d2bd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-59aa0465-ea6e-467f-8193-675764d8d2bd-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "cinder-quobyte-59aa0465-ea6e-467f-8193-675764d8d2bd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-quobyte-59aa0465-ea6e-467f-8193-675764d8d2bd" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e07d45-ec5d-453e-aca8-c161fec776aa]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:21:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:21:59 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd
Sep 09 13:21:59 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:00 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd" returned: 0 in 0.603s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:00 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd
Sep 09 13:22:00 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:00 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-59aa0465-ea6e-467f-8193-675764d8d2bd" returned: 0 in 0.326s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-quobyte-59aa0465-ea6e-467f-8193-675764d8d2bd" released by "delete_volume" :: held 1.012s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:00 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-83af4655-031e-4432-8860-ce952eba947c req-7fb84dd0-7365-48cd-892b-4c66ae7afdb7 tempest-AttachVolumeNegativeTest-389404715 None] Terminate volume connection completed successfully.
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-83af4655-031e-4432-8860-ce952eba947c req-7fb84dd0-7365-48cd-892b-4c66ae7afdb7 tempest-AttachVolumeNegativeTest-389404715 None] Deleting attachment 794f22b4-33f8-49e5-9ba5-df7316e1d7aa. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Created reservations ['431341ad-f81d-4c56-b806-d0b8552b6231', '4e6c2631-249c-4a83-bda0-3ae14878b01a', '334df14c-d32e-4af4-8753-fb95876b87c1', '9d2d1540-edca-4a4e-ad0b-38ef6c0842d1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:00 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:00 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:01 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.326s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:01 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Deleted volume successfully.
Sep 09 13:22:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-28e7be00-cc4b-48ba-b142-a3c68c6d5f8e tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-59aa0465-ea6e-467f-8193-675764d8d2bd-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Flow 'volume_create_manager' (c68f9927-d3dc-40d9-aed0-059b8238ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46e7b62-ba9f-4088-bcfe-82642606b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46e7b62-ba9f-4088-bcfe-82642606b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-957170230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5655c7e-c12b-4403-91d5-6a992ff08224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdc456c22ae40c589d6ce05d5dd7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:03Z,use_quota=True,user_id='4e7f1ddf550241beb39c9d3640d4e846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac23fea-ef3c-457a-bbe8-bdbca8e8fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac23fea-ef3c-457a-bbe8-bdbca8e8fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893b2772-f2e2-4503-905e-4267ddbe1b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893b2772-f2e2-4503-905e-4267ddbe1b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5655c7e-c12b-4403-91d5-6a992ff08224', 'volume_name': 'volume-f5655c7e-c12b-4403-91d5-6a992ff08224', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee1e211-d72f-4f91-810a-c9332c11fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee1e211-d72f-4f91-810a-c9332c11fd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ceca17-9eaa-4c42-9bd9-692ae4f04650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:02 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Volume f5655c7e-c12b-4403-91d5-6a992ff08224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5655c7e-c12b-4403-91d5-6a992ff08224', 'volume_size': 1}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-957170230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5655c7e-c12b-4403-91d5-6a992ff08224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdc456c22ae40c589d6ce05d5dd7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:03Z,use_quota=True,user_id='4e7f1ddf550241beb39c9d3640d4e846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Creating volume f5655c7e-c12b-4403-91d5-6a992ff08224 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:02 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:02 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 1073741824
Sep 09 13:22:02 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:03 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 1073741824" returned: 0 in 0.601s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:03 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224
Sep 09 13:22:03 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:03 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ceca17-9eaa-4c42-9bd9-692ae4f04650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5655c7e-c12b-4403-91d5-6a992ff08224', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98708497-39ad-4c9b-8ea2-56ff44414510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Volume volume-f5655c7e-c12b-4403-91d5-6a992ff08224 (f5655c7e-c12b-4403-91d5-6a992ff08224): created successfully
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98708497-39ad-4c9b-8ea2-56ff44414510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Flow 'volume_create_manager' (c68f9927-d3dc-40d9-aed0-059b8238ee81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0c52f14e-1d78-4a43-a45b-0386139e80cc tempest-VolumesTransfersV355Test-485869874 None] Created volume successfully.
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "cinder-f5655c7e-c12b-4403-91d5-6a992ff08224-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-f5655c7e-c12b-4403-91d5-6a992ff08224-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "cinder-quobyte-f5655c7e-c12b-4403-91d5-6a992ff08224" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-quobyte-f5655c7e-c12b-4403-91d5-6a992ff08224" acquired by "delete_volume" :: waited 0.050s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68a921-bfe9-42d6-9af9-c52e1d6821dd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:05 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224
Sep 09 13:22:05 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:05 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224" returned: 0 in 0.571s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:05 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224
Sep 09 13:22:05 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:06 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f5655c7e-c12b-4403-91d5-6a992ff08224" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-quobyte-f5655c7e-c12b-4403-91d5-6a992ff08224" released by "delete_volume" :: held 0.980s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Created reservations ['df727d92-09ae-4b6d-afac-b968db29e71f', '7e2cd81f-8e5e-42aa-b57c-21b86d31a337', 'f0ccdcc6-46c6-4386-b93a-4eb668b0f345', '9f4cdf71-0cea-4a75-979c-cff1cf4a80db'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:06 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:06 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:06 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.372s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Deleted volume successfully.
Sep 09 13:22:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c82f819f-1c3c-47f3-b53a-dd3492545fea tempest-VolumesTransfersV355Test-1970620186 None] Lock "cinder-f5655c7e-c12b-4403-91d5-6a992ff08224-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-a04e07c7-66c3-4643-bddc-b0d024bd6cfd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-a04e07c7-66c3-4643-bddc-b0d024bd6cfd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-quobyte-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be49cd5-552d-4810-bfd8-d2c7b07fb794]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:07 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd
Sep 09 13:22:07 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:08 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" returned: 0 in 0.479s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:08 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd
Sep 09 13:22:08 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:08 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-a04e07c7-66c3-4643-bddc-b0d024bd6cfd" released by "delete_volume" :: held 0.798s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Created reservations ['f721ef49-f9be-4665-bc56-23bc1a3f9028', 'b0b0f566-0e00-43e0-94f2-a3235911f142', 'e0c95a22-dd5b-4923-9d75-7646b3cc78b4', 'c3f1b049-8886-434b-aaff-6129b4d69175'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:08 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:08 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:08 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-05e3f286-08bf-44e2-9484-8d41cd5905ad-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.356s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Deleted volume successfully.
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-05e3f286-08bf-44e2-9484-8d41cd5905ad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3f097698-d7e6-4673-8b02-8be0fdfc5206 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-a04e07c7-66c3-4643-bddc-b0d024bd6cfd-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-quobyte-05e3f286-08bf-44e2-9484-8d41cd5905ad" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-05e3f286-08bf-44e2-9484-8d41cd5905ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d71783-a657-4966-9307-fca61ccdacfa]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:09 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad
Sep 09 13:22:09 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:09 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:09 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad
Sep 09 13:22:09 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:09 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-05e3f286-08bf-44e2-9484-8d41cd5905ad" returned: 0 in 0.341s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-05e3f286-08bf-44e2-9484-8d41cd5905ad" released by "delete_volume" :: held 1.008s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Created reservations ['291d4298-b7eb-49f0-82af-0b8facf0ef9d', 'fcdc96d1-33d4-4ec7-88ae-6425931cbe47', '18dffc3b-d2d9-4c11-a183-ec3bd7e74f3e', 'f60e3c7e-2b12-46a2-b26f-ad9af02a9d40'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:10 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:10 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:10 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Deleted volume successfully.
Sep 09 13:22:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e28bb85f-d954-4336-9a97-1098e9fb44c6 tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-05e3f286-08bf-44e2-9484-8d41cd5905ad-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-aa0c81e5-6601-4202-a0c2-d213552d3caa-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-aa0c81e5-6601-4202-a0c2-d213552d3caa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "cinder-quobyte-aa0c81e5-6601-4202-a0c2-d213552d3caa" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-aa0c81e5-6601-4202-a0c2-d213552d3caa" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26cf852-8ef1-4029-b171-762af5e561cd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:11 devstack sudo[99505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa
Sep 09 13:22:11 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:12 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa" returned: 0 in 0.477s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:12 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa
Sep 09 13:22:12 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:12 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aa0c81e5-6601-4202-a0c2-d213552d3caa" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-quobyte-aa0c81e5-6601-4202-a0c2-d213552d3caa" released by "delete_volume" :: held 0.916s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Created reservations ['cfb4e5c4-76e1-40b9-94fe-9331019745b8', 'dc5ee85c-42fb-43ab-8044-7ee7ede0d7eb', 'a4006e20-58e7-4b0b-999b-5f72cab7024a', 'e4d6345d-8786-4e19-9374-71e1b2788f27'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:12 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:12 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:12 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.277s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Deleted volume successfully.
Sep 09 13:22:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97525ccf-4824-49cf-862e-d4886feb519c tempest-AttachVolumeNegativeTest-389404715 None] Lock "cinder-aa0c81e5-6601-4202-a0c2-d213552d3caa-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:22 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=88,cinder:INSERT=20,cinder:UPDATE=100,cinder:DELETE=6 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:22:22 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=64,cinder:INSERT=26,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:25 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:25 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (5ab87378-4e66-4d20-9e06-c24b31b3d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bfdf3-010c-4e96-98f7-dd075d5e906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bfdf3-010c-4e96-98f7-dd075d5e906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552025402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a4a556-1081-48c0-a2af-634b5fbee177,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:25Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc788c-8875-4c26-b2a3-5d321a9705c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc788c-8875-4c26-b2a3-5d321a9705c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1777ebc7-e39f-4e69-ba65-99665876725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1777ebc7-e39f-4e69-ba65-99665876725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a4a556-1081-48c0-a2af-634b5fbee177', 'volume_name': 'volume-f8a4a556-1081-48c0-a2af-634b5fbee177', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be8a2d-a309-4005-8fcd-670b41853147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be8a2d-a309-4005-8fcd-670b41853147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eea345-e779-47f4-b27d-e4d6a2f0790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Volume f8a4a556-1081-48c0-a2af-634b5fbee177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a4a556-1081-48c0-a2af-634b5fbee177', 'volume_size': 1}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552025402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a4a556-1081-48c0-a2af-634b5fbee177,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:25Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Creating volume f8a4a556-1081-48c0-a2af-634b5fbee177 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:25 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:25 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 1073741824
Sep 09 13:22:25 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:25 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.487s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Flow 'volume_create_manager' (101ab945-656c-413b-bd27-0ba265ecdc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8817f417-9099-4458-829b-5b8553e46a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8817f417-9099-4458-829b-5b8553e46a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1887794942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e554bdf-449e-40c9-b300-794748d90ce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='832d90e4e4834837a5cdb7f1b1213f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:26Z,use_quota=True,user_id='d237d265829d47e5af7c555e6ee33b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b67dd4-e7ed-4af9-a154-bd29bbb5e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b67dd4-e7ed-4af9-a154-bd29bbb5e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131b044-d3ed-4dcf-8d56-f8e7a9b6f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131b044-d3ed-4dcf-8d56-f8e7a9b6f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e554bdf-449e-40c9-b300-794748d90ce7', 'volume_name': 'volume-4e554bdf-449e-40c9-b300-794748d90ce7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3286b716-0a89-4b58-8d55-56ce183df157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3286b716-0a89-4b58-8d55-56ce183df157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43393d6c-1a3f-4448-b7c4-46c55b51ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Volume 4e554bdf-449e-40c9-b300-794748d90ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e554bdf-449e-40c9-b300-794748d90ce7', 'volume_size': 1}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:26 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 1073741824" returned: 0 in 0.689s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:26 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177
Sep 09 13:22:26 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:26 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1887794942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e554bdf-449e-40c9-b300-794748d90ce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='832d90e4e4834837a5cdb7f1b1213f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:26Z,use_quota=True,user_id='d237d265829d47e5af7c555e6ee33b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Creating volume 4e554bdf-449e-40c9-b300-794748d90ce7 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36eea345-e779-47f4-b27d-e4d6a2f0790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a4a556-1081-48c0-a2af-634b5fbee177', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 1073741824
Sep 09 13:22:26 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63363b6b-0d1f-481b-b0cc-3eafa26d3027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Volume volume-f8a4a556-1081-48c0-a2af-634b5fbee177 (f8a4a556-1081-48c0-a2af-634b5fbee177): created successfully
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63363b6b-0d1f-481b-b0cc-3eafa26d3027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (5ab87378-4e66-4d20-9e06-c24b31b3d81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-808296fa-0554-4fec-a88d-41d6127aaf62 tempest-VolumesListTestJSON-976143312 None] Created volume successfully.
Sep 09 13:22:27 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 1073741824" returned: 0 in 0.626s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:27 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7
Sep 09 13:22:27 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:27 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7" returned: 0 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43393d6c-1a3f-4448-b7c4-46c55b51ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e554bdf-449e-40c9-b300-794748d90ce7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d557a12e-b097-48ac-8b52-0a8a20e534eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Volume volume-4e554bdf-449e-40c9-b300-794748d90ce7 (4e554bdf-449e-40c9-b300-794748d90ce7): created successfully
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d557a12e-b097-48ac-8b52-0a8a20e534eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Flow 'volume_create_manager' (101ab945-656c-413b-bd27-0ba265ecdc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-ac3e625f-4a9b-4dc0-8e09-87027eb6864d req-a5f20c2b-f901-42d9-a7a4-980097584ee9 tempest-VolumesGetTestJSON-432208339 None] Created volume successfully.
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (993a34d8-b017-4202-8342-aa5187341260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6e2f22-6b31-4cf3-afa2-146e39fbb10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6e2f22-6b31-4cf3-afa2-146e39fbb10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-485919817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed722504-bd02-429f-8bbf-17dc07c5b72c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:28Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7cd6f-53fd-481c-8999-4ad10810c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7cd6f-53fd-481c-8999-4ad10810c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c3c48d-6b81-4381-bb00-d1e362acb23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c3c48d-6b81-4381-bb00-d1e362acb23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed722504-bd02-429f-8bbf-17dc07c5b72c', 'volume_name': 'volume-ed722504-bd02-429f-8bbf-17dc07c5b72c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ca73c2-a95c-49f6-b1d3-8bb1e1c78889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ca73c2-a95c-49f6-b1d3-8bb1e1c78889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d540b1e-fd9a-4af8-a862-5708f8b6f7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Volume ed722504-bd02-429f-8bbf-17dc07c5b72c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed722504-bd02-429f-8bbf-17dc07c5b72c', 'volume_size': 1}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-485919817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed722504-bd02-429f-8bbf-17dc07c5b72c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:28Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Creating volume ed722504-bd02-429f-8bbf-17dc07c5b72c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:28 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:28 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c 1073741824
Sep 09 13:22:28 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Acquiring lock "cinder-4e554bdf-449e-40c9-b300-794748d90ce7-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "cinder-4e554bdf-449e-40c9-b300-794748d90ce7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Acquiring lock "cinder-quobyte-4e554bdf-449e-40c9-b300-794748d90ce7" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "cinder-quobyte-4e554bdf-449e-40c9-b300-794748d90ce7" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69dc4a-69fd-48e2-afdd-f2d001a37c88]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:29 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7
Sep 09 13:22:29 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:29 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c 1073741824" returned: 0 in 0.839s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:29 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c
Sep 09 13:22:29 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:29 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7" returned: 0 in 0.650s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:29 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7
Sep 09 13:22:29 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:29 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c" returned: 0 in 0.613s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:29 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4e554bdf-449e-40c9-b300-794748d90ce7" returned: 0 in 0.458s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d540b1e-fd9a-4af8-a862-5708f8b6f7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed722504-bd02-429f-8bbf-17dc07c5b72c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e71ca9-abf4-4166-aac9-1be255288ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "cinder-quobyte-4e554bdf-449e-40c9-b300-794748d90ce7" released by "delete_volume" :: held 1.187s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Volume volume-ed722504-bd02-429f-8bbf-17dc07c5b72c (ed722504-bd02-429f-8bbf-17dc07c5b72c): created successfully
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e71ca9-abf4-4166-aac9-1be255288ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (993a34d8-b017-4202-8342-aa5187341260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c7355565-92ab-45d5-be5c-9cacde7006ef tempest-VolumesListTestJSON-976143312 None] Created volume successfully.
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.quota [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Created reservations ['25ad43a2-65c7-46ce-a6e3-9739e1a54b55', '5edf486d-1151-4e59-b5ef-f47b3d334ac6', '1496638b-b16f-4eee-9758-5c6fd2c51b2d', 'f0a299b6-2414-48fe-b2e0-c2044074407e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:30 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:30 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:30 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.403s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.manager [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Deleted volume successfully.
Sep 09 13:22:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-393bbffc-91b5-4ea0-a851-02df77694cbb req-8191a49f-a156-48c5-aa6a-0a456acfdb0e tempest-VolumesGetTestJSON-432208339 None] Lock "cinder-4e554bdf-449e-40c9-b300-794748d90ce7-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (0ca6e9da-f56a-4d5b-a2ac-cbb6e26c9c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca18149b-1f4c-491f-a72a-bdd4660fc326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca18149b-1f4c-491f-a72a-bdd4660fc326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627940393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea2303e-00aa-47aa-ac43-3d39c961cc43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:31Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4ab5b8-0787-4ead-8274-a273553f1ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4ab5b8-0787-4ead-8274-a273553f1ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40310e51-3741-454b-9f75-ac13e06c1e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40310e51-3741-454b-9f75-ac13e06c1e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea2303e-00aa-47aa-ac43-3d39c961cc43', 'volume_name': 'volume-cea2303e-00aa-47aa-ac43-3d39c961cc43', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88c0766-192e-4dd8-a5b4-a8c8ca276c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88c0766-192e-4dd8-a5b4-a8c8ca276c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d21594a-5e80-4140-ae02-fc954726ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:31 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Volume cea2303e-00aa-47aa-ac43-3d39c961cc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea2303e-00aa-47aa-ac43-3d39c961cc43', 'volume_size': 1}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627940393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea2303e-00aa-47aa-ac43-3d39c961cc43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df2b8ec54c534cd5a9e321c66eeb7e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:31Z,use_quota=True,user_id='020b0efd2eff43a9b6986b511b41b4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Creating volume cea2303e-00aa-47aa-ac43-3d39c961cc43 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:31 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:31 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 1073741824
Sep 09 13:22:31 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:32 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 1073741824" returned: 0 in 0.569s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:32 devstack sudo[99681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43
Sep 09 13:22:32 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:32 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d21594a-5e80-4140-ae02-fc954726ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea2303e-00aa-47aa-ac43-3d39c961cc43', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce0f891-e51f-4239-b212-02b39a512a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Volume volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 (cea2303e-00aa-47aa-ac43-3d39c961cc43): created successfully
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce0f891-e51f-4239-b212-02b39a512a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Flow 'volume_create_manager' (0ca6e9da-f56a-4d5b-a2ac-cbb6e26c9c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bf287979-5dd1-4104-9ad1-c0c7e209201e tempest-VolumesListTestJSON-976143312 None] Created volume successfully.
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-cea2303e-00aa-47aa-ac43-3d39c961cc43-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "cinder-cea2303e-00aa-47aa-ac43-3d39c961cc43-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-quobyte-cea2303e-00aa-47aa-ac43-3d39c961cc43" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-cea2303e-00aa-47aa-ac43-3d39c961cc43" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e639013e-d801-4af6-99fc-c825d42c9c42]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2220c7e-f568-4169-a3ec-9d90883b8754 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-2020522633: creating
Sep 09 13:22:36 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43
Sep 09 13:22:36 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2220c7e-f568-4169-a3ec-9d90883b8754 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-2020522633: created successfully
Sep 09 13:22:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2220c7e-f568-4169-a3ec-9d90883b8754 tempest-GroupSnapshotsTest-1774785419 None] Create group completed successfully.
Sep 09 13:22:37 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43" returned: 0 in 0.473s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:37 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43
Sep 09 13:22:37 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:37 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cea2303e-00aa-47aa-ac43-3d39c961cc43" returned: 0 in 0.295s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-cea2303e-00aa-47aa-ac43-3d39c961cc43" released by "delete_volume" :: held 0.832s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Created reservations ['7e114dc9-0c1d-4318-844e-cb7120f7c04d', '0031a77e-6ff6-48b0-948b-b31b47c7b45e', 'f227d2ad-97ae-4dc2-9cf7-a2680634b420', '393762ca-a432-40de-8edb-882618170d60'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:37 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:37 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-ed722504-bd02-429f-8bbf-17dc07c5b72c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-ed722504-bd02-429f-8bbf-17dc07c5b72c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-quobyte-ed722504-bd02-429f-8bbf-17dc07c5b72c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-ed722504-bd02-429f-8bbf-17dc07c5b72c" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d525a481-f15a-4bd1-b031-c96c475b5e0d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:37 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Deleted volume successfully.
Sep 09 13:22:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2efe99fe-a0d7-4404-9603-5cc9d6c294db tempest-VolumesListTestJSON-976143312 None] Lock "cinder-cea2303e-00aa-47aa-ac43-3d39c961cc43-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:37 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c
Sep 09 13:22:37 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:38 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c" returned: 0 in 0.508s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:38 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c
Sep 09 13:22:38 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (1bccc995-66e2-4e58-8dd7-bf51391a8e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ce8ab8-9337-40fb-a729-5b9b01627f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ce8ab8-9337-40fb-a729-5b9b01627f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089837546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fff4a8-54ba-4933-8950-bf4caae8c4ca,host='devstack@QuobyteHD#QuobyteHD',id=9a9393f9-51d0-4ddc-ac9d-690db2629908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:38Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b99c9-71fb-4423-addf-573a81ef3757),volume_type_id=069b99c9-71fb-4423-addf-573a81ef3757)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160bbd6d-b809-4698-928a-6f7f3b7c51dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160bbd6d-b809-4698-928a-6f7f3b7c51dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf40068-0280-4393-9870-77324517441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf40068-0280-4393-9870-77324517441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9393f9-51d0-4ddc-ac9d-690db2629908', 'volume_name': 'volume-9a9393f9-51d0-4ddc-ac9d-690db2629908', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e9841f-4183-4bda-95cd-5820a0e3eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e9841f-4183-4bda-95cd-5820a0e3eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c46c9ad-0c1d-468e-9a32-894a63c92eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Volume 9a9393f9-51d0-4ddc-ac9d-690db2629908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9393f9-51d0-4ddc-ac9d-690db2629908', 'volume_size': 1}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=33fff4a8-54ba-4933-8950-bf4caae8c4ca,created_at=2026-09-09T11:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089837546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=33fff4a8-54ba-4933-8950-bf4caae8c4ca,host='devstack@QuobyteHD#QuobyteHD',id=9a9393f9-51d0-4ddc-ac9d-690db2629908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:22:38Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069b99c9-71fb-4423-addf-573a81ef3757),volume_type_id=069b99c9-71fb-4423-addf-573a81ef3757)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Creating volume 9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:38 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 1073741824
Sep 09 13:22:38 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:38 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ed722504-bd02-429f-8bbf-17dc07c5b72c" returned: 0 in 0.342s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-ed722504-bd02-429f-8bbf-17dc07c5b72c" released by "delete_volume" :: held 0.902s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Created reservations ['c6b0e432-7ef0-4b14-960e-7ff5c8980870', 'c1a15d88-1733-44e7-863f-4b1f713f5808', '38626dc7-8d14-44f9-af42-f93f93182cbd', '7090948d-12be-4b2f-a3a3-03587207b85a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:38 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:38 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-f8a4a556-1081-48c0-a2af-634b5fbee177-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-f8a4a556-1081-48c0-a2af-634b5fbee177-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "cinder-quobyte-f8a4a556-1081-48c0-a2af-634b5fbee177" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-f8a4a556-1081-48c0-a2af-634b5fbee177" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:39 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Deleted volume successfully.
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956a209-871e-42bb-81b6-8d0265c65205]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c7d4e406-3d0d-457f-b4e9-3ff8ba780695 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-ed722504-bd02-429f-8bbf-17dc07c5b72c-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:39 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 1073741824" returned: 0 in 0.732s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:39 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177
Sep 09 13:22:39 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:39 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:22:39 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:39 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.410s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c46c9ad-0c1d-468e-9a32-894a63c92eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9393f9-51d0-4ddc-ac9d-690db2629908', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42054873-df7a-478b-85ec-f443609ff1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:22:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Volume volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 (9a9393f9-51d0-4ddc-ac9d-690db2629908): created successfully
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42054873-df7a-478b-85ec-f443609ff1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (1bccc995-66e2-4e58-8dd7-bf51391a8e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:22:39 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177" returned: 0 in 0.641s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5e3e404d-3296-4fbd-bf09-4e7830c4437b tempest-GroupSnapshotsTest-1774785419 None] Created volume successfully.
Sep 09 13:22:39 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177
Sep 09 13:22:39 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:40 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f8a4a556-1081-48c0-a2af-634b5fbee177" returned: 0 in 0.479s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-quobyte-f8a4a556-1081-48c0-a2af-634b5fbee177" released by "delete_volume" :: held 1.188s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Created reservations ['8fdce57d-efba-4899-b16f-0150325d23f6', '23021434-58ac-4ee0-bd75-69a8717d3208', 'ef8c3c16-1d97-406e-9505-faa51aaa1e0c', '41a1f220-4fd1-443f-94b4-dc9c127f4a0a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:40 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:40 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:40 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:40 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Deleted volume successfully.
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d31fb1ab-c7fc-468f-8e01-554b9ccc6ce5 tempest-VolumesListTestJSON-976143312 None] Lock "cinder-f8a4a556-1081-48c0-a2af-634b5fbee177-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] GroupSnapshot 80efe414-e68f-435f-838d-c5953f3296f2: creating.
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Group snapshot 80efe414-e68f-435f-838d-c5953f3296f2: creating. {{(pid=87606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Creating offline snapshot 2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc of volume 9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd8e4b2-fe5e-4c4c-a27e-dc2f2c9e98fc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:41 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:22:41 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:42 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.550s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:42 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc 1G
Sep 09 13:22:42 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:42 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc 1G" returned: 0 in 0.674s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:42 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:22:42 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:43 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.441s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:43 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:22:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:43 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:22:43 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:43 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:43 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info
Sep 09 13:22:43 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:44 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info" returned: 0 in 0.608s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:44 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:22:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:44 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info
Sep 09 13:22:44 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:44 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.info" returned: 0 in 0.371s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5d889889-267f-4c5e-aef0-6086862467ab tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 80efe414-e68f-435f-838d-c5953f3296f2: created successfully
Sep 09 13:22:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-0da81c69-0375-41b2-896e-4b4b7612831e req-5541f96b-d88f-4441-9dc3-037b7516065a tempest-TestMinimumBasicScenario-535353943 None] Terminate volume connection completed successfully.
Sep 09 13:22:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-0da81c69-0375-41b2-896e-4b4b7612831e req-5541f96b-d88f-4441-9dc3-037b7516065a tempest-TestMinimumBasicScenario-535353943 None] Deleting attachment ab20203b-98b8-47be-a0b1-038d4ff8b277. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Creating volume f7ab567f-c8cb-4973-9439-e1fb0009fdc2 from snapshot 2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] snapshot: 2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc, volume: f7ab567f-c8cb-4973-9439-e1fb0009fdc2,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "cinder-d831ab7f-9302-46e3-8bae-6cefaf493dab-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591deba-9eb9-43a9-8ccb-eab91fef39e9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "cinder-d831ab7f-9302-46e3-8bae-6cefaf493dab-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "cinder-quobyte-d831ab7f-9302-46e3-8bae-6cefaf493dab" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "cinder-quobyte-d831ab7f-9302-46e3-8bae-6cefaf493dab" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e3403-e18a-4938-ada4-7a10403d7407]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:47 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:22:47 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:47 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab
Sep 09 13:22:47 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:48 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.797s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9393f9-51d0-4ddc-ac9d-690db2629908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605418d-7662-48f2-8c12-b6497398b28b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:48 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab" returned: 0 in 0.693s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:48 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:22:48 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:48 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab
Sep 09 13:22:48 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:48 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.513s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:48 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d831ab7f-9302-46e3-8bae-6cefaf493dab" returned: 0 in 0.472s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:48 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2
Sep 09 13:22:48 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "cinder-quobyte-d831ab7f-9302-46e3-8bae-6cefaf493dab" released by "delete_volume" :: held 1.234s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Created reservations ['9a3a4c94-b06d-4008-be80-f0a926fe3d64', 'e724e3b4-3d4c-4d64-8987-048d9afb4684', '42e387f3-1b1c-4bca-9853-2019b507a268', '4dc08921-1fe9-4248-98bb-2801f35c9100'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:49 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:49 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:49 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Deleted volume successfully.
Sep 09 13:22:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0c8365-f92d-467a-b665-a726623f4b72 tempest-TestMinimumBasicScenario-535353943 None] Lock "cinder-d831ab7f-9302-46e3-8bae-6cefaf493dab-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:56 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" returned: 0 in 7.477s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:22:56 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Converted 1024.00 MB image at 136.94 MB/s
Sep 09 13:22:56 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:56 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2
Sep 09 13:22:56 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:56 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" returned: 0 in 0.275s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" released by "_copy_volume_from_snapshot" :: held 9.257s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" released by "_create_volume_from_snapshot" :: held 9.381s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.425s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b546aeb1-30d7-4dbe-a903-dfc57e4430a7 tempest-GroupSnapshotsTest-1774785419 None] Create group from source-snapshot-80efe414-e68f-435f-838d-c5953f3296f2 completed successfully.
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7bd87-f55c-4290-8c6b-c79f307e64e2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:58 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2
Sep 09 13:22:58 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:58 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" returned: 0 in 0.477s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:58 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2
Sep 09 13:22:58 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:58 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" returned: 0 in 0.293s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-f7ab567f-c8cb-4973-9439-e1fb0009fdc2" released by "delete_volume" :: held 0.829s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['8db7ef77-3edd-4d4a-ae4f-c81ab4fba5ce'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:59 devstack cinder-volume[87606]: WARNING cinder.quota [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1208566541 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1208566541, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:22:59 devstack cinder-volume[87606]: WARNING cinder.quota [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1208566541 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1208566541, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['f8f8c7a6-d743-4e2c-a6c8-ce486bea3add', 'f3a2a2ea-7725-41ed-9ed2-741753e56057', '9e9812d7-ce62-4be4-bfc5-1ca2884370c5', 'eac11e1a-7de6-4eb4-ae8e-3eaee777c28b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:59 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:22:59 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 80efe414-e68f-435f-838d-c5953f3296f2: deleting
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 80efe414-e68f-435f-838d-c5953f3296f2: deleting {{(pid=87606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Deleting offline snapshot 2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc of volume 9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] snapshot_file for this snap is: volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5050913-5746-4683-a759-cdf804151aec]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:22:59 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:22:59 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:22:59 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.459s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:22:59 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:22:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-eae7d2b6-2654-4892-ae7e-6e171a02b770 tempest-GroupSnapshotsTest-1774785419 None] Delete group completed successfully.
Sep 09 13:23:00 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.514s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9393f9-51d0-4ddc-ac9d-690db2629908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db8b1c0-24c2-4196-bb7f-535a78d156dc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:00 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:23:00 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:00 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.619s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:00 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:23:00 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:01 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.372s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:01 devstack sudo[99961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc
Sep 09 13:23:01 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:01 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908.2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" returned: 0 in 0.244s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-2b2b9a1f-bbdb-423f-953c-ca76a3e7cfbc" released by "_delete_snapshot" :: held 1.880s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" released by "delete_snapshot" :: held 1.914s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:01 devstack cinder-volume[87606]: WARNING cinder.quota [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1208566541 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1208566541, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['149c1548-8e0f-45a3-841c-057b5e80e469', 'cab7107f-6845-4d64-8e92-67d281702964', 'e7d2d84b-cee8-43bf-8b3d-35078fd7e0a4', 'b8487360-a753-4a1d-b075-70616edf0a14'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4720f198-2f93-4bd9-9a64-6a05547b4039 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 80efe414-e68f-435f-838d-c5953f3296f2: deleted successfully
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[149bd542-a672-4f71-bc34-a08b3227bc7d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:02 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:23:02 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:02 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.582s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:03 devstack sudo[99970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908
Sep 09 13:23:03 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:03 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9a9393f9-51d0-4ddc-ac9d-690db2629908" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-9a9393f9-51d0-4ddc-ac9d-690db2629908" released by "delete_volume" :: held 1.046s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['ce943e4f-74b6-4a37-b74a-fb02448382cd'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:03 devstack cinder-volume[87606]: WARNING cinder.db.api [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1208566541']
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['fbae5eb0-e00f-4f94-936a-4d421bef036c', 'f9d51c62-5366-4ae5-bf5d-07250c4d42ea', '452e37da-6601-4629-af00-345300dad9df', '4fdf0070-18c9-43d8-aec0-0e1137bf983d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:03 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:03 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:04 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:04 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5d21181c-bcbb-4886-9e00-fb4ae52dd5c8 tempest-GroupSnapshotsTest-1774785419 None] Delete group completed successfully.
Sep 09 13:23:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-504d83bc-dc30-4c2c-b1fe-cda77b60f525 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-1272235657: creating
Sep 09 13:23:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-504d83bc-dc30-4c2c-b1fe-cda77b60f525 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-1272235657: created successfully
Sep 09 13:23:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-504d83bc-dc30-4c2c-b1fe-cda77b60f525 tempest-GroupSnapshotsTest-1774785419 None] Create group completed successfully.
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (55a0099f-bc54-48c7-953f-e34da3525524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354f5c3c-37c3-4527-a82b-76ce788b7d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354f5c3c-37c3-4527-a82b-76ce788b7d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876432848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f928a2b-98e5-4558-be3d-c77034ab9389,host='devstack@QuobyteHD#QuobyteHD',id=d8508d54-3315-4391-a50b-e2cf9d690137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:06Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eaf42e-ee80-4137-8652-56df6900bde9),volume_type_id=44eaf42e-ee80-4137-8652-56df6900bde9)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2813c7-8aab-4e0f-b2b9-c75b19a18cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2813c7-8aab-4e0f-b2b9-c75b19a18cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8250a0-968b-46e2-9449-2adfb9b2e4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8250a0-968b-46e2-9449-2adfb9b2e4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8508d54-3315-4391-a50b-e2cf9d690137', 'volume_name': 'volume-d8508d54-3315-4391-a50b-e2cf9d690137', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0d662b-d9f7-4711-938e-de134268a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0d662b-d9f7-4711-938e-de134268a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c39abd-f4a3-4bb5-8836-41b4a08ec5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:06 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Volume d8508d54-3315-4391-a50b-e2cf9d690137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8508d54-3315-4391-a50b-e2cf9d690137', 'volume_size': 1}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5f928a2b-98e5-4558-be3d-c77034ab9389,created_at=2026-09-09T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876432848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f928a2b-98e5-4558-be3d-c77034ab9389,host='devstack@QuobyteHD#QuobyteHD',id=d8508d54-3315-4391-a50b-e2cf9d690137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:06Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eaf42e-ee80-4137-8652-56df6900bde9),volume_type_id=44eaf42e-ee80-4137-8652-56df6900bde9)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Creating volume d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:06 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:06 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 1073741824
Sep 09 13:23:06 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:07 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 1073741824" returned: 0 in 0.663s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:07 devstack sudo[99986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137
Sep 09 13:23:07 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Flow 'volume_create_manager' (9758729e-0c76-443c-b90e-7adac078a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb88485-b60e-4639-aa56-c1353ef29751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb88485-b60e-4639-aa56-c1353ef29751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2088192501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1122a928-2131-42ce-9ab4-c91d9d175807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fb52f7f1e3420fb5c03a228aca01f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:07Z,use_quota=True,user_id='4fbaffac8c76463dba82245aa5edcaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9546daa8-1cc9-4ebe-a6da-000eb5d827c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9546daa8-1cc9-4ebe-a6da-000eb5d827c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7471b890-6319-467b-b722-147adfa1d8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7471b890-6319-467b-b722-147adfa1d8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1122a928-2131-42ce-9ab4-c91d9d175807', 'volume_name': 'volume-1122a928-2131-42ce-9ab4-c91d9d175807', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6447f839-db4e-46ba-b71a-53ce783e5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6447f839-db4e-46ba-b71a-53ce783e5da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308095a3-7226-4a63-9d9e-c90ac3a27411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Volume 1122a928-2131-42ce-9ab4-c91d9d175807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1122a928-2131-42ce-9ab4-c91d9d175807', 'volume_size': 1}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:07 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2088192501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1122a928-2131-42ce-9ab4-c91d9d175807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9fb52f7f1e3420fb5c03a228aca01f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:07Z,use_quota=True,user_id='4fbaffac8c76463dba82245aa5edcaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Creating volume 1122a928-2131-42ce-9ab4-c91d9d175807 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:07 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c39abd-f4a3-4bb5-8836-41b4a08ec5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8508d54-3315-4391-a50b-e2cf9d690137', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e5416e-d628-4116-814a-40499312efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:07 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 1073741824
Sep 09 13:23:07 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:07 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Volume volume-d8508d54-3315-4391-a50b-e2cf9d690137 (d8508d54-3315-4391-a50b-e2cf9d690137): created successfully
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e5416e-d628-4116-814a-40499312efa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (55a0099f-bc54-48c7-953f-e34da3525524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f6378e5e-abbf-4511-9c27-a4815c720c02 tempest-GroupSnapshotsTest-1774785419 None] Created volume successfully.
Sep 09 13:23:08 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 1073741824" returned: 0 in 0.641s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:08 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807
Sep 09 13:23:08 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:08 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807" returned: 0 in 0.336s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308095a3-7226-4a63-9d9e-c90ac3a27411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1122a928-2131-42ce-9ab4-c91d9d175807', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d5dbe9-6dd4-4fee-9122-d7d4dd161e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:08 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Volume volume-1122a928-2131-42ce-9ab4-c91d9d175807 (1122a928-2131-42ce-9ab4-c91d9d175807): created successfully
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d5dbe9-6dd4-4fee-9122-d7d4dd161e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Flow 'volume_create_manager' (9758729e-0c76-443c-b90e-7adac078a46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d43ec7f6-37bf-463c-8a85-0f57bd79f30a tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Created volume successfully.
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (80c8dfed-f212-46bb-918a-61da1f02722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e5a1df-55b3-4993-8141-10bf329159a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e5a1df-55b3-4993-8141-10bf329159a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1819356169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f928a2b-98e5-4558-be3d-c77034ab9389,host='devstack@QuobyteHD#QuobyteHD',id=797d0ee2-9361-4bff-892f-d49607550da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:09Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eaf42e-ee80-4137-8652-56df6900bde9),volume_type_id=44eaf42e-ee80-4137-8652-56df6900bde9)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803073ce-3d6c-4ae6-af24-77e570b15f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803073ce-3d6c-4ae6-af24-77e570b15f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34293f4-f193-4d8e-ba42-803cdd4c40cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34293f4-f193-4d8e-ba42-803cdd4c40cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797d0ee2-9361-4bff-892f-d49607550da2', 'volume_name': 'volume-797d0ee2-9361-4bff-892f-d49607550da2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c7bd36-f08e-4381-82a9-fd3dfc708398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c7bd36-f08e-4381-82a9-fd3dfc708398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11f4a76-f642-4269-bba3-04912851a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Volume 797d0ee2-9361-4bff-892f-d49607550da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797d0ee2-9361-4bff-892f-d49607550da2', 'volume_size': 1}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5f928a2b-98e5-4558-be3d-c77034ab9389,created_at=2026-09-09T11:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1819356169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f928a2b-98e5-4558-be3d-c77034ab9389,host='devstack@QuobyteHD#QuobyteHD',id=797d0ee2-9361-4bff-892f-d49607550da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:09Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44eaf42e-ee80-4137-8652-56df6900bde9),volume_type_id=44eaf42e-ee80-4137-8652-56df6900bde9)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Creating volume 797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:09 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:09 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 1073741824
Sep 09 13:23:09 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:10 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 1073741824" returned: 0 in 0.727s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:10 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2
Sep 09 13:23:10 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1cdbcbd6-2c57-4bff-8179-deedc3811236 req-70c94694-0723-4c71-aab6-0463b4f0a7e9 tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:10 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1cdbcbd6-2c57-4bff-8179-deedc3811236 req-70c94694-0723-4c71-aab6-0463b4f0a7e9 tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.138s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1cdbcbd6-2c57-4bff-8179-deedc3811236 req-70c94694-0723-4c71-aab6-0463b4f0a7e9 tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11f4a76-f642-4269-bba3-04912851a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797d0ee2-9361-4bff-892f-d49607550da2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985956b3-a066-4482-a4a7-e3f42807f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:10 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Volume volume-797d0ee2-9361-4bff-892f-d49607550da2 (797d0ee2-9361-4bff-892f-d49607550da2): created successfully
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985956b3-a066-4482-a4a7-e3f42807f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (80c8dfed-f212-46bb-918a-61da1f02722a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3c610db8-d70c-4677-bf3c-d59dd1fc0a88 tempest-GroupSnapshotsTest-1774785419 None] Created volume successfully.
Sep 09 13:23:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-1cdbcbd6-2c57-4bff-8179-deedc3811236 req-70c94694-0723-4c71-aab6-0463b4f0a7e9 tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-1122a928-2131-42ce-9ab4-c91d9d175807', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5ad0009-643e-4c17-8393-ca9563bdc218', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:23:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-1cdbcbd6-2c57-4bff-8179-deedc3811236 req-70c94694-0723-4c71-aab6-0463b4f0a7e9 tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] attachment_update completed successfully.
Sep 09 13:23:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7228f6c1-f231-46ae-b11e-a426180934aa tempest-GroupSnapshotsTest-1774785419 None] Update group completed successfully.
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Flow 'volume_create_manager' (fe378d4f-ef06-426f-ba2a-8a5ed4d15e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d89bfd6-84b1-4c70-956c-261fc7beb476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d89bfd6-84b1-4c70-956c-261fc7beb476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff08cf7-9cbe-484b-b827-f9fc9ce610cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e173ea9092c42d19a068bcaf71d23c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:13Z,use_quota=True,user_id='08e2966ffc2746eaa05a01448a2b762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bac669-33c4-46b0-93fa-cc76c988a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bac669-33c4-46b0-93fa-cc76c988a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebebdeb6-7f93-4958-9c84-3b25b6609c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebebdeb6-7f93-4958-9c84-3b25b6609c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff08cf7-9cbe-484b-b827-f9fc9ce610cd', 'volume_name': 'volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0448eb-5031-4d83-b2c6-a7af853dafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0448eb-5031-4d83-b2c6-a7af853dafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2c4887-d081-457d-b9a3-ace41276ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:13 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Volume 9ff08cf7-9cbe-484b-b827-f9fc9ce610cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd', 'volume_size': 1}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff08cf7-9cbe-484b-b827-f9fc9ce610cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e173ea9092c42d19a068bcaf71d23c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:13Z,use_quota=True,user_id='08e2966ffc2746eaa05a01448a2b762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Creating volume 9ff08cf7-9cbe-484b-b827-f9fc9ce610cd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:13 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:13 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd 1073741824
Sep 09 13:23:13 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:13 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d17bdca8-b99e-43ea-905b-50ad9e30c13c tempest-GroupSnapshotsTest-1774785419 None] Update group completed successfully.
Sep 09 13:23:14 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd 1073741824" returned: 0 in 0.610s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:14 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd
Sep 09 13:23:14 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-fd28e225-b81a-4ff8-b5bc-1de1cd6ba7b5 req-29b0ddaf-647a-41df-91f9-7b35e5fb06ab tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Terminate volume connection completed successfully.
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-fd28e225-b81a-4ff8-b5bc-1de1cd6ba7b5 req-29b0ddaf-647a-41df-91f9-7b35e5fb06ab tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Deleting attachment a5ad0009-643e-4c17-8393-ca9563bdc218. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:23:14 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" returned: 0 in 0.317s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2c4887-d081-457d-b9a3-ace41276ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6deb041-13b7-4f6a-a09a-9f442638b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:14 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Volume volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd (9ff08cf7-9cbe-484b-b827-f9fc9ce610cd): created successfully
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6deb041-13b7-4f6a-a09a-9f442638b286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Flow 'volume_create_manager' (fe378d4f-ef06-426f-ba2a-8a5ed4d15e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b3a34bd7-01c2-4162-9863-f58c3160d0c0 tempest-CinderUnicodeTest-376772816 None] Created volume successfully.
Sep 09 13:23:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a27e743d-603b-4962-a74b-0381acca407b tempest-GroupSnapshotsTest-1774785419 None] Update group completed successfully.
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "cinder-1122a928-2131-42ce-9ab4-c91d9d175807-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "cinder-1122a928-2131-42ce-9ab4-c91d9d175807-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "cinder-quobyte-1122a928-2131-42ce-9ab4-c91d9d175807" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "cinder-quobyte-1122a928-2131-42ce-9ab4-c91d9d175807" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4bb69-745d-4a80-8d20-ec6d7b22b7be]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:15 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807
Sep 09 13:23:15 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:15 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807" returned: 0 in 0.448s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:15 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807
Sep 09 13:23:15 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ad5526cf-73fc-49ea-90bc-fd484f346354 tempest-GroupSnapshotsTest-1774785419 None] Update group completed successfully.
Sep 09 13:23:16 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1122a928-2131-42ce-9ab4-c91d9d175807" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "cinder-quobyte-1122a928-2131-42ce-9ab4-c91d9d175807" released by "delete_volume" :: held 0.881s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Flow 'volume_create_manager' (101bc9b9-6ddc-48f7-b9b6-3100e2422656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e8128e-a148-44f2-a177-ecf83cb5ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e8128e-a148-44f2-a177-ecf83cb5ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1100095548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd935e85-ba58-4a23-9cc3-f562570eaa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e173ea9092c42d19a068bcaf71d23c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:16Z,use_quota=True,user_id='08e2966ffc2746eaa05a01448a2b762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10d2a71-72d9-4cf0-b7fa-fb4886c635ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10d2a71-72d9-4cf0-b7fa-fb4886c635ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9773e7a7-f6be-40e8-9788-a3e9f6b629f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9773e7a7-f6be-40e8-9788-a3e9f6b629f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd935e85-ba58-4a23-9cc3-f562570eaa9d', 'volume_name': 'volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43931360-f85b-43bd-bad0-256022d50d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43931360-f85b-43bd-bad0-256022d50d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a266faa-cb35-4e8e-a90a-ace484db0485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:16 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Volume bd935e85-ba58-4a23-9cc3-f562570eaa9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d', 'volume_size': 1}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1100095548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd935e85-ba58-4a23-9cc3-f562570eaa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e173ea9092c42d19a068bcaf71d23c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:16Z,use_quota=True,user_id='08e2966ffc2746eaa05a01448a2b762e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Creating volume bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:16 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:16 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d 1073741824
Sep 09 13:23:16 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Created reservations ['f360ea57-4218-4059-acf2-1f8426696fcd', '97081d4d-b22a-4d83-8f8f-a90b9def5e13', 'b0e343c8-4742-46ea-ba26-6ae6fe751b4a', '71707d5c-1743-402e-8dcb-44ee24ec67ac'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:16 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:16 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:16 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Deleted volume successfully.
Sep 09 13:23:16 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d 1073741824" returned: 0 in 0.460s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-309cf355-a983-4e7d-a7fc-b9ca66dc1f7e tempest-TestServerVolumeAttachScenarioOldVersion-1778200303 None] Lock "cinder-1122a928-2131-42ce-9ab4-c91d9d175807-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:16 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d
Sep 09 13:23:16 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:17 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a266faa-cb35-4e8e-a90a-ace484db0485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a2d0d9-59f2-483a-b16b-20df929eea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Volume volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d (bd935e85-ba58-4a23-9cc3-f562570eaa9d): created successfully
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a2d0d9-59f2-483a-b16b-20df929eea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Flow 'volume_create_manager' (101bc9b9-6ddc-48f7-b9b6-3100e2422656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:17 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-94fa812d-08b5-49e2-8eb0-6cfaafee93a8 tempest-CinderUnicodeTest-376772816 None] Created volume successfully.
Sep 09 13:23:17 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] GroupSnapshot f308766c-633b-4b86-8ef6-62950facdda0: creating.
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Group snapshot f308766c-633b-4b86-8ef6-62950facdda0: creating. {{(pid=87606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Creating offline snapshot 0ac1871a-3ec9-4e1a-bb52-5be125b017fb of volume 797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be27ade-3167-4f05-a750-5595c4f4f666]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:17 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2
Sep 09 13:23:17 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:18 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2" returned: 0 in 0.793s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:18 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb 1G
Sep 09 13:23:18 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:19 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb 1G" returned: 0 in 0.726s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-797d0ee2-9361-4bff-892f-d49607550da2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:19 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-797d0ee2-9361-4bff-892f-d49607550da2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb
Sep 09 13:23:19 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:19 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-797d0ee2-9361-4bff-892f-d49607550da2 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:19 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:19 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb
Sep 09 13:23:19 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:19 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb" returned: 0 in 0.317s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:19 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info
Sep 09 13:23:19 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:20 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info" returned: 0 in 0.379s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:20 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:20 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info
Sep 09 13:23:20 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:20 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.info" returned: 0 in 0.314s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Creating offline snapshot e1873022-ddc9-4792-9e70-1521b1a46485 of volume d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[784478c1-dffe-42c2-89ce-f5eec4d14e46]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:20 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137
Sep 09 13:23:20 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:21 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137" returned: 0 in 0.446s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:21 devstack sudo[100558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 1G
Sep 09 13:23:21 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Flow 'volume_create_manager' (e8b4ac92-bdc6-4cdf-ad51-a814582a2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0260ce-3835-40a0-9db0-e2b7d09f2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0260ce-3835-40a0-9db0-e2b7d09f2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-631188992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1341a8f-081a-4518-bd7e-f080f33b54df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee11dc2376346ff8dcd92d59e7efa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:21Z,use_quota=True,user_id='848a8806d83c41b8a4b557700086adc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b29c3f-e6b9-4f28-ad0c-539f34bd340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b29c3f-e6b9-4f28-ad0c-539f34bd340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989dc874-7504-470b-959f-1b904641f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989dc874-7504-470b-959f-1b904641f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1341a8f-081a-4518-bd7e-f080f33b54df', 'volume_name': 'volume-c1341a8f-081a-4518-bd7e-f080f33b54df', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50543f69-e57f-440e-9cf5-603575e8521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50543f69-e57f-440e-9cf5-603575e8521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d196b-cb78-40ae-9855-d7cfa40599da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume c1341a8f-081a-4518-bd7e-f080f33b54df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1341a8f-081a-4518-bd7e-f080f33b54df', 'volume_size': 1}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Flow 'volume_create_manager' (1d1ea166-2a2a-4480-b92b-71ebf6c815f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bec29cc-ac0e-4d11-aa97-02675a35c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bec29cc-ac0e-4d11-aa97-02675a35c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-809429469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6684b201-fcba-40d1-af50-ed854757c468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee11dc2376346ff8dcd92d59e7efa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:22Z,use_quota=True,user_id='848a8806d83c41b8a4b557700086adc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c90522e-598f-419a-a28e-918af147a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c90522e-598f-419a-a28e-918af147a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0607acd0-d101-4a1c-96d9-48769c41746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0607acd0-d101-4a1c-96d9-48769c41746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6684b201-fcba-40d1-af50-ed854757c468', 'volume_name': 'volume-6684b201-fcba-40d1-af50-ed854757c468', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fd5401-76b0-4a65-be6a-942325785e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fd5401-76b0-4a65-be6a-942325785e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcecbe-2aa0-4d92-be2f-5a2d3c846834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume 6684b201-fcba-40d1-af50-ed854757c468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6684b201-fcba-40d1-af50-ed854757c468', 'volume_size': 1}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 1G" returned: 0 in 0.525s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8508d54-3315-4391-a50b-e2cf9d690137 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:21 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8508d54-3315-4391-a50b-e2cf9d690137 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485
Sep 09 13:23:21 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:22 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8508d54-3315-4391-a50b-e2cf9d690137 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:22 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:22 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485
Sep 09 13:23:22 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:22 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:22 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info
Sep 09 13:23:22 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:22 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info" returned: 0 in 0.293s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:22 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:22 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info
Sep 09 13:23:22 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:22 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.info" returned: 0 in 0.286s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.941s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=107,cinder:UPDATE=122,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:23:22 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=118,cinder:SELECT=119,cinder:DELETE=8,cinder:INSERT=28 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:23:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Creating offline snapshot d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 of volume bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:23:23 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d3fa0c-0a06-4c56-a6b2-c5ce57723bd1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:23 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7d28baee-0b7e-4178-970d-3f73ae0ce6ed tempest-GroupSnapshotsTest-1774785419 None] group_snapshot f308766c-633b-4b86-8ef6-62950facdda0: created successfully
Sep 09 13:23:23 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d
Sep 09 13:23:23 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:23 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d" returned: 0 in 0.468s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:23 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 1G
Sep 09 13:23:23 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:23 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 1G" returned: 0 in 0.495s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:24 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70
Sep 09 13:23:24 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] group_snapshot f308766c-633b-4b86-8ef6-62950facdda0: deleting
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] group_snapshot f308766c-633b-4b86-8ef6-62950facdda0: deleting {{(pid=87606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-0ac1871a-3ec9-4e1a-bb52-5be125b017fb" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-0ac1871a-3ec9-4e1a-bb52-5be125b017fb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Deleting offline snapshot 0ac1871a-3ec9-4e1a-bb52-5be125b017fb of volume 797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] snapshot_file for this snap is: volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a793b9a3-af89-47f7-bb3b-42de347dfa0d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:24 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" returned: 0 in 0.538s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:24 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 is being set with open permissions: ugo+rw
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:24 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70
Sep 09 13:23:24 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:24 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb
Sep 09 13:23:24 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:24 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" returned: 0 in 0.341s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:24 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb" returned: 0 in 0.479s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-797d0ee2-9361-4bff-892f-d49607550da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f225c7d-fa6f-49e9-8349-53ab0a9842d3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:24 devstack sudo[100603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info
Sep 09 13:23:24 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2
Sep 09 13:23:25 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:25 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info is being set with open permissions: ugo+rw
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:25 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info
Sep 09 13:23:25 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:25 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2" returned: 0 in 0.610s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:25 devstack sudo[100618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb
Sep 09 13:23:25 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.353s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:23:25 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.info" returned: 0 in 0.421s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-631188992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1341a8f-081a-4518-bd7e-f080f33b54df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee11dc2376346ff8dcd92d59e7efa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:21Z,use_quota=True,user_id='848a8806d83c41b8a4b557700086adc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Creating volume c1341a8f-081a-4518-bd7e-f080f33b54df {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:25 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:25 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df 1073741824
Sep 09 13:23:25 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6dd0a450-9ebc-4712-a4b7-98dc4df3a72c tempest-CinderUnicodeTest-376772816 None] Create snapshot completed successfully
Sep 09 13:23:26 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb" returned: 0 in 0.459s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:26 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb
Sep 09 13:23:26 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:26 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df 1073741824" returned: 0 in 0.560s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:26 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2.0ac1871a-3ec9-4e1a-bb52-5be125b017fb" returned: 0 in 0.338s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-0ac1871a-3ec9-4e1a-bb52-5be125b017fb" released by "_delete_snapshot" :: held 2.069s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" released by "delete_snapshot" :: held 2.119s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:26 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df
Sep 09 13:23:26 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-e1873022-ddc9-4792-9e70-1521b1a46485" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-e1873022-ddc9-4792-9e70-1521b1a46485" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Deleting offline snapshot e1873022-ddc9-4792-9e70-1521b1a46485 of volume d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] snapshot_file for this snap is: volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" acquired by "delete_snapshot" :: waited 0.099s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-quobyte-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[42181ff6-12d6-4143-a03a-9d9941a3024d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Deleting offline snapshot d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 of volume bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] snapshot_file for this snap is: volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa52d44-9543-4dc3-87c5-6f9664d89184]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:26 devstack sudo[100636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485
Sep 09 13:23:26 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:26 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df" returned: 0 in 0.472s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.243s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-809429469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6684b201-fcba-40d1-af50-ed854757c468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee11dc2376346ff8dcd92d59e7efa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:22Z,use_quota=True,user_id='848a8806d83c41b8a4b557700086adc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Creating volume 6684b201-fcba-40d1-af50-ed854757c468 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:27 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70
Sep 09 13:23:27 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:27 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 1073741824
Sep 09 13:23:27 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d196b-cb78-40ae-9855-d7cfa40599da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1341a8f-081a-4518-bd7e-f080f33b54df', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f768f-d4ea-4eec-8bde-637fe1e0e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume volume-c1341a8f-081a-4518-bd7e-f080f33b54df (c1341a8f-081a-4518-bd7e-f080f33b54df): created successfully
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f768f-d4ea-4eec-8bde-637fe1e0e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Flow 'volume_create_manager' (e8b4ac92-bdc6-4cdf-ad51-a814582a2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-90f00889-182a-4af2-bb83-19c4c0be1bf6 tempest-TestServerVolumeAttachmentScenario-917796865 None] Created volume successfully.
Sep 09 13:23:27 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485" returned: 0 in 0.675s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8508d54-3315-4391-a50b-e2cf9d690137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:23:27 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" returned: 0 in 0.602s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d009dd-c109-47c0-8c9d-75dd7db30753]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873f2a9-0c5f-4214-8ac7-c65cf47d5fd2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:27 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137
Sep 09 13:23:27 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d
Sep 09 13:23:27 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:27 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:27 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 1073741824" returned: 0 in 0.964s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137" returned: 0 in 0.585s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:28 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:28 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485
Sep 09 13:23:28 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d" returned: 0 in 0.607s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:28 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468
Sep 09 13:23:28 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:28 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70
Sep 09 13:23:28 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:28 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468" returned: 0 in 0.434s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcecbe-2aa0-4d92-be2f-5a2d3c846834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6684b201-fcba-40d1-af50-ed854757c468', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72ed5a9-fd35-4a38-9aa8-af0d52e1433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Volume volume-6684b201-fcba-40d1-af50-ed854757c468 (6684b201-fcba-40d1-af50-ed854757c468): created successfully
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72ed5a9-fd35-4a38-9aa8-af0d52e1433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Flow 'volume_create_manager' (1d1ea166-2a2a-4480-b92b-71ebf6c815f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:28 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" returned: 0 in 0.483s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f19b0c78-70f7-4bc8-a851-29feb8199cee tempest-TestServerVolumeAttachmentScenario-917796865 None] Created volume successfully.
Sep 09 13:23:28 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485" returned: 0 in 0.576s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:28 devstack sudo[100693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70
Sep 09 13:23:28 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:28 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485
Sep 09 13:23:28 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:28 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d.d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:28 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137.e1873022-ddc9-4792-9e70-1521b1a46485" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-e1873022-ddc9-4792-9e70-1521b1a46485" released by "_delete_snapshot" :: held 2.402s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70" released by "_delete_snapshot" :: held 2.316s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" released by "delete_snapshot" :: held 2.444s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" released by "delete_snapshot" :: held 2.382s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:29 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1868836323 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1868836323, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:29 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1868836323 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1868836323, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['3dba60fd-ab58-4061-b496-00f1abac5c22', 'b1de1077-63d9-45cc-9a1b-cf3cbf0b5e86', '475c6bc7-637a-4456-ae82-c10cf99797dc', 'a383a5f1-4d02-4da7-9adb-e46620a4871e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Created reservations ['753a7548-e219-4ce2-aeff-6bf7c9d2a3d7', 'a20cfe45-3379-405b-ae6f-fac7009ad55a', '0104d5f5-751f-4bb0-8f01-ca957471c239', '20e2f9ea-7f99-4332-ae46-ac13b0c9c3f7'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Delete snapshot completed successfully.
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c0691d55-7568-4fb4-b989-05bc589cf5c2 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-d10fbd7d-1ec7-4fe3-8738-3e2f72cddb70-delete_snapshot" released by "delete_snapshot" :: held 2.831s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['dc5dfa6b-f13e-4e81-aacf-4b58d55dc721', '33bc7ee1-c8ae-4e5c-82e6-16c2045bdf13', 'efb97ceb-24b2-49a8-98e5-c82ce97bb97b', '3bf0d13b-735b-4bcc-a3f6-c4e9a708138f'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b4ae811d-8322-4741-82c9-577b2e6ac6bf tempest-GroupSnapshotsTest-1774785419 None] group_snapshot f308766c-633b-4b86-8ef6-62950facdda0: deleted successfully
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-bd935e85-ba58-4a23-9cc3-f562570eaa9d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-bd935e85-ba58-4a23-9cc3-f562570eaa9d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3af1be0-db26-4b21-afa5-d68243619542]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:30 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d
Sep 09 13:23:30 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:30 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d" returned: 0 in 0.588s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:30 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d
Sep 09 13:23:30 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" acquired by "delete_volume" :: waited 0.062s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30308a3-1ca9-45da-a174-cc6baf21ed89]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:31 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2
Sep 09 13:23:31 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:31 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bd935e85-ba58-4a23-9cc3-f562570eaa9d" returned: 0 in 0.732s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-bd935e85-ba58-4a23-9cc3-f562570eaa9d" released by "delete_volume" :: held 1.450s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Created reservations ['c524605e-d860-4d6e-aba2-91dd7eeb74be', '56f94f84-566b-426a-8f14-b2c1630f7021', '77e7a62b-8d92-4777-a856-a1a27dd0193e', '19c8ea51-d94b-4e40-845f-aa030ca66e0c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:31 devstack sudo[100782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:31 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:31 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2" returned: 0 in 0.946s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:32 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2
Sep 09 13:23:32 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:32 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.549s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Deleted volume successfully.
Sep 09 13:23:32 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-797d0ee2-9361-4bff-892f-d49607550da2" returned: 0 in 0.491s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-797d0ee2-9361-4bff-892f-d49607550da2" released by "delete_volume" :: held 1.599s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5b145ed8-3032-451d-9348-156514de5c09 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-bd935e85-ba58-4a23-9cc3-f562570eaa9d-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" acquired by "delete_volume" :: waited 0.051s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5348e549-3815-48b0-af33-07e1686dc518]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "cinder-quobyte-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e3d0e-d1f1-4746-ba61-312bb5df12a6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:32 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137
Sep 09 13:23:32 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:32 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd
Sep 09 13:23:32 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:33 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137" returned: 0 in 0.749s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:33 devstack sudo[100808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137
Sep 09 13:23:33 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:33 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" returned: 0 in 0.803s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:33 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd
Sep 09 13:23:33 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:33 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d8508d54-3315-4391-a50b-e2cf9d690137" returned: 0 in 0.534s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-d8508d54-3315-4391-a50b-e2cf9d690137" released by "delete_volume" :: held 1.397s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:33 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" returned: 0 in 0.494s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-quobyte-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd" released by "delete_volume" :: held 1.372s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['89d52f11-be21-49d1-8581-2ed7f9847a77'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:34 devstack cinder-volume[87606]: WARNING cinder.quota [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1868836323 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1868836323, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Created reservations ['76db6288-d757-49ef-9cea-05ac7a73e17d', '0d0e38af-0ede-4c79-8320-e8c662d8b7a1', '74139766-a5f2-4c25-912c-76d38869d9be', 'fc8fb0da-5bb2-4510-823b-27a170c0b07e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['f078d769-f133-4207-b5b8-aa4c3e5ef447', '490e7663-30d2-4aff-9b3a-6a18317fa144', '60619334-379c-45c6-ad43-6f2f2dbee020', 'd8401803-99c7-4a6a-82f1-6bd82ceaa2d2'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:34 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:34 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['89f5995d-3401-40fd-bd79-01c8f988fdec', '06dabb66-cd71-4735-a8c7-3e032beceade', 'c8ff2de9-578e-4b72-a358-35d7cf3907ac', '0b1fa84b-c8e3-4e6d-953c-66dfe6bee79f'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:34 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:34 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:34 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.282s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Deleted volume successfully.
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-177de14d-f44c-4212-ae1b-3c4dc36c91d6 tempest-CinderUnicodeTest-376772816 None] Lock "cinder-9ff08cf7-9cbe-484b-b827-f9fc9ce610cd-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:34 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:34 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9359a7d3-4eba-4878-bdd1-e8675d3549a2 tempest-GroupSnapshotsTest-1774785419 None] Delete group completed successfully.
Sep 09 13:23:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-14a406fd-7975-4ffc-b2f4-f17f719c8092 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-855743551: creating
Sep 09 13:23:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-14a406fd-7975-4ffc-b2f4-f17f719c8092 tempest-GroupSnapshotsTest-1774785419 None] Group tempest-GroupSnapshotsTest-Group-855743551: created successfully
Sep 09 13:23:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-14a406fd-7975-4ffc-b2f4-f17f719c8092 tempest-GroupSnapshotsTest-1774785419 None] Create group completed successfully.
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (9690c74e-6133-4b7c-92cb-349d72c71a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baadb313-f03d-414f-867a-cfabf093103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baadb313-f03d-414f-867a-cfabf093103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147243664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f62350a-cd6f-41fa-ae38-e211cb6dd7b2,host='devstack@QuobyteHD#QuobyteHD',id=38d415bc-014a-4189-a40a-6f297711d058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:38Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9f1223d-b036-4734-b1bf-ee0d4d4dd238),volume_type_id=d9f1223d-b036-4734-b1bf-ee0d4d4dd238)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce04361-3921-4d88-8892-fad75caf30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce04361-3921-4d88-8892-fad75caf30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ca5f57-6315-4020-9a47-4d8e26aa81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ca5f57-6315-4020-9a47-4d8e26aa81b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d415bc-014a-4189-a40a-6f297711d058', 'volume_name': 'volume-38d415bc-014a-4189-a40a-6f297711d058', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a3775e-1c42-43ff-8935-0925c4064ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a3775e-1c42-43ff-8935-0925c4064ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a032d11c-6285-4303-8906-f33c3753a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Volume 38d415bc-014a-4189-a40a-6f297711d058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d415bc-014a-4189-a40a-6f297711d058', 'volume_size': 1}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8f62350a-cd6f-41fa-ae38-e211cb6dd7b2,created_at=2026-09-09T11:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2147243664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f62350a-cd6f-41fa-ae38-e211cb6dd7b2,host='devstack@QuobyteHD#QuobyteHD',id=38d415bc-014a-4189-a40a-6f297711d058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71153b1385149f4b48cdaafc38263b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:38Z,use_quota=True,user_id='b238fecf17284216a80eb1d678b12e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9f1223d-b036-4734-b1bf-ee0d4d4dd238),volume_type_id=d9f1223d-b036-4734-b1bf-ee0d4d4dd238)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Creating volume 38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:38 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 1073741824
Sep 09 13:23:38 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:38 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 1073741824" returned: 0 in 0.601s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:38 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058
Sep 09 13:23:38 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:39 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a032d11c-6285-4303-8906-f33c3753a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d415bc-014a-4189-a40a-6f297711d058', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c582af30-6140-4bce-86ed-5b69d221e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Volume volume-38d415bc-014a-4189-a40a-6f297711d058 (38d415bc-014a-4189-a40a-6f297711d058): created successfully
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c582af30-6140-4bce-86ed-5b69d221e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Flow 'volume_create_manager' (9690c74e-6133-4b7c-92cb-349d72c71a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-19d46625-4d95-4627-8882-39d4de16b796 tempest-GroupSnapshotsTest-1774785419 None] Created volume successfully.
Sep 09 13:23:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] GroupSnapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: creating.
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Group snapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: creating. {{(pid=87606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Creating offline snapshot 1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 of volume 38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:23:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3673265b-aa7a-425a-8356-1e473893c7bd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:40 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058
Sep 09 13:23:40 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:40 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058" returned: 0 in 0.511s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:40 devstack sudo[100839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 1G
Sep 09 13:23:40 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:41 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 1G" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d415bc-014a-4189-a40a-6f297711d058 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:41 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d415bc-014a-4189-a40a-6f297711d058 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65
Sep 09 13:23:41 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:41 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d415bc-014a-4189-a40a-6f297711d058 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" returned: 0 in 0.431s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:41 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:41 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65
Sep 09 13:23:41 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:41 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" returned: 0 in 0.335s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:41 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info
Sep 09 13:23:41 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:42 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:42 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:23:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:42 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info
Sep 09 13:23:42 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:42 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.info" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5fa1c229-8ffd-4a9a-9f4e-30062ea7bc57 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: created successfully
Sep 09 13:23:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: deleting
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: deleting {{(pid=87606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Deleting offline snapshot 1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 of volume 38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] snapshot_file for this snap is: volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39fd077-33a0-4fea-b60c-02bbdc3f3478]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:43 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65
Sep 09 13:23:43 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:44 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" returned: 0 in 0.557s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38d415bc-014a-4189-a40a-6f297711d058(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[93170d5b-d893-4ae2-bd26-238c5399308c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:44 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058
Sep 09 13:23:44 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:44 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058" returned: 0 in 0.590s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:44 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65
Sep 09 13:23:44 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:45 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" returned: 0 in 0.482s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:45 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65
Sep 09 13:23:45 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:45 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058.1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" returned: 0 in 0.283s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-1ed4d686-84c4-48d8-8bb7-28a85e1dbd65" released by "_delete_snapshot" :: held 2.071s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" released by "delete_snapshot" :: held 2.108s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:45 devstack cinder-volume[87606]: WARNING cinder.quota [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1918496783 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1918496783, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:45 devstack cinder-volume[87606]: WARNING cinder.quota [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1918496783 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1918496783, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:45 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['879b9267-ca7e-4735-9650-9478a9869490', '65fdaadf-2f61-495e-9a41-82b36ea33f9d', '9ffda6b7-4b8b-4e07-8b6a-fe6dc24c39b8', '6f4d678e-4be1-40ce-979e-aaed5ab01670'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2fad5022-42fc-44c3-b0a1-6900ab490521 tempest-GroupSnapshotsTest-1774785419 None] group_snapshot 88f52abc-8e0d-46f2-ab34-3ece23d81d60: deleted successfully
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ec003-48dc-430a-a739-ea4e45bc09b1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:46 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058
Sep 09 13:23:46 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:46 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058" returned: 0 in 0.445s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:46 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058
Sep 09 13:23:46 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:47 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-38d415bc-014a-4189-a40a-6f297711d058" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Lock "cinder-quobyte-38d415bc-014a-4189-a40a-6f297711d058" released by "delete_volume" :: held 0.886s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['af98b57a-b9ae-4b2e-b334-5271f5490c62'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (074914f6-444a-4487-ac04-b2636096c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2d0098-2f5f-490d-ba98-ab16b3a95c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:47 devstack cinder-volume[87606]: WARNING cinder.quota [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1918496783 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1918496783, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2d0098-2f5f-490d-ba98-ab16b3a95c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046928123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:47Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655002af-76f7-4a78-b684-258466c4217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655002af-76f7-4a78-b684-258466c4217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f1054-6495-44f5-bfb4-2148060fe715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5f1054-6495-44f5-bfb4-2148060fe715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b', 'volume_name': 'volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482507a8-310c-41b8-98f0-7562c5b1c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482507a8-310c-41b8-98f0-7562c5b1c639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c45cfea-b399-4920-807c-05d726ed8983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Volume 0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b', 'volume_size': 1}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046928123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:47Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Creating volume 0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:47 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b 1073741824
Sep 09 13:23:47 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Created reservations ['1872302b-ceee-408e-b71e-ddfa685f7fda', 'b06cd1d5-4cb3-4e33-a99b-82fe59cbc9c9', '5b5e5e19-8a42-4801-9be8-11f548c0a16a', 'b531967e-321c-4f12-bc18-29a4b546c0bd'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:47 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:47 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:47 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.295s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4bfaf755-695e-48db-81c7-ee0761c8e82a tempest-GroupSnapshotsTest-1774785419 None] Delete group completed successfully.
Sep 09 13:23:47 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b 1073741824" returned: 0 in 0.492s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:48 devstack sudo[100911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b
Sep 09 13:23:48 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:48 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" returned: 0 in 0.389s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c45cfea-b399-4920-807c-05d726ed8983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129debb4-56f4-42fe-8565-78abb872bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Volume volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b (0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b): created successfully
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129debb4-56f4-42fe-8565-78abb872bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (074914f6-444a-4487-ac04-b2636096c13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-472cff85-d608-4214-86a8-10d4401cc5e6 tempest-ProjectReaderTests-279736192 None] Created volume successfully.
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "cinder-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-quobyte-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bc4f0-8195-4f23-ab66-06b592d887dd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:50 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b
Sep 09 13:23:50 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:50 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" returned: 0 in 0.490s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:50 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b
Sep 09 13:23:50 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:50 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b" released by "delete_volume" :: held 0.853s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Created reservations ['603fb5d2-1a40-4ba4-9573-09826b57627c', 'ad1621c7-60b6-45cf-8bbb-1ca88ed79366', '770adf00-b1ca-4a79-ac94-1c8da465e39c', 'c602e575-8547-4187-a1f9-613278ae403e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:50 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:50 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:51 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.437s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Deleted volume successfully.
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c94b82f2-1e68-461d-a03d-b84a17eb1fbd tempest-ProjectReaderTests-279736192 None] Lock "cinder-0a2d4e50-d70f-4b35-8a3d-c4b13b0d951b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (29bd4dd3-57da-44f4-aeef-ba5a8eb42774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bec954-1b2a-4280-9df7-9a45b26a50be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bec954-1b2a-4280-9df7-9a45b26a50be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305789849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3fb8701-c487-41ad-8f3e-72665d3648bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:52Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3b419f-cd05-47c9-afc5-64371d5e7d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3b419f-cd05-47c9-afc5-64371d5e7d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4f7d6-165a-4efc-8bc6-5d1e5e81bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4f7d6-165a-4efc-8bc6-5d1e5e81bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3fb8701-c487-41ad-8f3e-72665d3648bc', 'volume_name': 'volume-d3fb8701-c487-41ad-8f3e-72665d3648bc', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed0032-a4c8-4c3f-b449-34beee014b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed0032-a4c8-4c3f-b449-34beee014b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d615f51-e0be-4e21-b8cd-7e4731d80cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:51 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Volume d3fb8701-c487-41ad-8f3e-72665d3648bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3fb8701-c487-41ad-8f3e-72665d3648bc', 'volume_size': 1}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305789849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3fb8701-c487-41ad-8f3e-72665d3648bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:52Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Creating volume d3fb8701-c487-41ad-8f3e-72665d3648bc {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:51 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:52 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc 1073741824
Sep 09 13:23:52 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:52 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc 1073741824" returned: 0 in 0.684s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:52 devstack sudo[100932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc
Sep 09 13:23:52 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:53 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc" returned: 0 in 0.364s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d615f51-e0be-4e21-b8cd-7e4731d80cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3fb8701-c487-41ad-8f3e-72665d3648bc', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0257e3-34aa-4923-a950-321dbdd7fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:53 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Volume volume-d3fb8701-c487-41ad-8f3e-72665d3648bc (d3fb8701-c487-41ad-8f3e-72665d3648bc): created successfully
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0257e3-34aa-4923-a950-321dbdd7fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (29bd4dd3-57da-44f4-aeef-ba5a8eb42774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-17a3b3a2-4745-42bc-acb3-2a5828d11861 tempest-ProjectReaderTests-279736192 None] Created volume successfully.
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-d3fb8701-c487-41ad-8f3e-72665d3648bc-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "cinder-d3fb8701-c487-41ad-8f3e-72665d3648bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-quobyte-d3fb8701-c487-41ad-8f3e-72665d3648bc" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-d3fb8701-c487-41ad-8f3e-72665d3648bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613f2b5-f9cb-4aab-8e66-58dad29f7678]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:54 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc
Sep 09 13:23:54 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:54 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc" returned: 0 in 0.414s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:54 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc
Sep 09 13:23:54 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:54 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d3fb8701-c487-41ad-8f3e-72665d3648bc" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-d3fb8701-c487-41ad-8f3e-72665d3648bc" released by "delete_volume" :: held 0.811s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:54 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Created reservations ['0c404a1e-9c62-43ae-a174-3a17b5011c38', '20cc1a4e-1bc2-4657-b654-5eea001bd0b2', 'fa118163-84e9-483b-ad5c-6175bf9033b5', 'cf008030-bde4-4e7b-ab2a-2cd8622b8664'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:55 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:55 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:55 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Deleted volume successfully.
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1691fdbd-911c-43a7-8a97-2eabb11f0145 tempest-ProjectReaderTests-279736192 None] Lock "cinder-d3fb8701-c487-41ad-8f3e-72665d3648bc-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (68ed4675-8b58-4312-9bcc-cf30d22d1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b298694-7146-4628-a047-4aed633fb60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b298694-7146-4628-a047-4aed633fb60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353290770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17436885-ab81-441c-9607-98d1b892a7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:56Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d3c0d0-cd99-4630-88fe-939bce5d063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d3c0d0-cd99-4630-88fe-939bce5d063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed65cc7f-5b04-45fb-bc70-00ceb488075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed65cc7f-5b04-45fb-bc70-00ceb488075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17436885-ab81-441c-9607-98d1b892a7da', 'volume_name': 'volume-17436885-ab81-441c-9607-98d1b892a7da', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4379ac4d-7514-4012-95bf-afb7801cbc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4379ac4d-7514-4012-95bf-afb7801cbc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74832a1d-1275-4168-8107-67d8c2bd77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Volume 17436885-ab81-441c-9607-98d1b892a7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17436885-ab81-441c-9607-98d1b892a7da', 'volume_size': 1}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353290770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17436885-ab81-441c-9607-98d1b892a7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:56Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Creating volume 17436885-ab81-441c-9607-98d1b892a7da {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:55 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:55 devstack sudo[100946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da 1073741824
Sep 09 13:23:55 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-91989170-859c-40e0-9f3e-55175f834359 tempest-GroupSnapshotsV319Test-830618186 None] Group tempest-GroupSnapshotsV319Test-Group-2095351080: creating
Sep 09 13:23:56 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da 1073741824" returned: 0 in 0.538s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-91989170-859c-40e0-9f3e-55175f834359 tempest-GroupSnapshotsV319Test-830618186 None] Group tempest-GroupSnapshotsV319Test-Group-2095351080: created successfully
Sep 09 13:23:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-91989170-859c-40e0-9f3e-55175f834359 tempest-GroupSnapshotsV319Test-830618186 None] Create group completed successfully.
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:56 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da
Sep 09 13:23:56 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:56 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74832a1d-1275-4168-8107-67d8c2bd77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17436885-ab81-441c-9607-98d1b892a7da', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b74038f-95f1-480d-a016-0e81373d362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Volume volume-17436885-ab81-441c-9607-98d1b892a7da (17436885-ab81-441c-9607-98d1b892a7da): created successfully
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b74038f-95f1-480d-a016-0e81373d362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (68ed4675-8b58-4312-9bcc-cf30d22d1500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d6d66c4e-e5b8-43c1-a9c7-f31559ced721 tempest-ProjectReaderTests-279736192 None] Created volume successfully.
Sep 09 13:23:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-17436885-ab81-441c-9607-98d1b892a7da-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "cinder-17436885-ab81-441c-9607-98d1b892a7da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-quobyte-17436885-ab81-441c-9607-98d1b892a7da" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-17436885-ab81-441c-9607-98d1b892a7da" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea92d82f-e905-4211-a3fe-92539322e548]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:58 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da
Sep 09 13:23:58 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Flow 'volume_create_manager' (a87be003-e288-4c2a-bf62-8d361b048ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650c6c73-9eac-4194-a28c-2eb8eb9d6d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650c6c73-9eac-4194-a28c-2eb8eb9d6d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1995015123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e2b5bc5-00d2-4c43-9aaa-85922fb2725c,host='devstack@QuobyteHD#QuobyteHD',id=a078f1dd-383b-4159-8012-8f377f215ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5080f46502c4bf688e2cb4e8b0b64c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:58Z,use_quota=True,user_id='8bb614bace974a9a98aaf36e6174adbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc371b3c-47fb-4c81-9963-154d0101d314),volume_type_id=bc371b3c-47fb-4c81-9963-154d0101d314)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9806d4b2-c2a8-4b5c-9b42-e98563dabffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9806d4b2-c2a8-4b5c-9b42-e98563dabffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5fdbe8-606d-4b74-bc9a-1e2eba2fcf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5fdbe8-606d-4b74-bc9a-1e2eba2fcf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a078f1dd-383b-4159-8012-8f377f215ac1', 'volume_name': 'volume-a078f1dd-383b-4159-8012-8f377f215ac1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87348ce5-13e0-4137-9669-8d89807d2c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87348ce5-13e0-4137-9669-8d89807d2c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93acd1d-6113-4b2e-9959-639000441d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:58 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Volume a078f1dd-383b-4159-8012-8f377f215ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a078f1dd-383b-4159-8012-8f377f215ac1', 'volume_size': 1}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4e2b5bc5-00d2-4c43-9aaa-85922fb2725c,created_at=2026-09-09T11:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1995015123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e2b5bc5-00d2-4c43-9aaa-85922fb2725c,host='devstack@QuobyteHD#QuobyteHD',id=a078f1dd-383b-4159-8012-8f377f215ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5080f46502c4bf688e2cb4e8b0b64c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:23:58Z,use_quota=True,user_id='8bb614bace974a9a98aaf36e6174adbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc371b3c-47fb-4c81-9963-154d0101d314),volume_type_id=bc371b3c-47fb-4c81-9963-154d0101d314)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Creating volume a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:23:58 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:58 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 1073741824
Sep 09 13:23:58 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:58 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da" returned: 0 in 0.580s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:58 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da
Sep 09 13:23:58 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:59 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 1073741824" returned: 0 in 0.581s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:59 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1
Sep 09 13:23:59 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:59 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-17436885-ab81-441c-9607-98d1b892a7da" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-17436885-ab81-441c-9607-98d1b892a7da" released by "delete_volume" :: held 1.054s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Created reservations ['c00f9105-b84f-41b9-88a5-6d07dee4dd2f', 'adefd4c6-a6a0-4d00-b1d1-b49cd224ab7a', '4e2fe88a-9d62-46d2-b9e5-6d3cd3733ca2', 'db7a7653-1bb0-496d-9ebd-6c9fbdd50ef8'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:23:59 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:23:59 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ec52730d-45c6-47eb-8514-686250d893aa req-ca992750-5bce-4144-9b9c-3ab294983ef1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:59 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1" returned: 0 in 0.340s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ec52730d-45c6-47eb-8514-686250d893aa req-ca992750-5bce-4144-9b9c-3ab294983ef1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.032s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93acd1d-6113-4b2e-9959-639000441d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a078f1dd-383b-4159-8012-8f377f215ac1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebb2f70-561b-4845-a6e2-781f5836caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ec52730d-45c6-47eb-8514-686250d893aa req-ca992750-5bce-4144-9b9c-3ab294983ef1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:23:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Volume volume-a078f1dd-383b-4159-8012-8f377f215ac1 (a078f1dd-383b-4159-8012-8f377f215ac1): created successfully
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebb2f70-561b-4845-a6e2-781f5836caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Flow 'volume_create_manager' (a87be003-e288-4c2a-bf62-8d361b048ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:23:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-98b03411-854d-40bf-a108-5349ac87fb96 tempest-GroupSnapshotsV319Test-830618186 None] Created volume successfully.
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ec52730d-45c6-47eb-8514-686250d893aa req-ca992750-5bce-4144-9b9c-3ab294983ef1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-c1341a8f-081a-4518-bd7e-f080f33b54df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20d6213f-61f4-420c-bc90-c842856107a5', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:23:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-ec52730d-45c6-47eb-8514-686250d893aa req-ca992750-5bce-4144-9b9c-3ab294983ef1 tempest-TestServerVolumeAttachmentScenario-917796865 None] attachment_update completed successfully.
Sep 09 13:23:59 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.321s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:23:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Deleted volume successfully.
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-789b084d-fc65-409d-ac37-7b5d218abb9c tempest-ProjectReaderTests-279736192 None] Lock "cinder-17436885-ab81-441c-9607-98d1b892a7da-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:23:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] GroupSnapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: creating.
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Group snapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: creating. {{(pid=87606) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:23:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Creating offline snapshot 3c7ad590-179a-4f1d-afea-18287b059c08 of volume a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5331e39-cbe5-4ec4-af5b-fb644ae04ad6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:00 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1
Sep 09 13:24:00 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:00 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1" returned: 0 in 0.542s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:00 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 1G
Sep 09 13:24:00 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (23b335bd-0d0e-4b78-ac55-fb1e4012ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07f5d0e-7868-44be-9687-650162fd8309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07f5d0e-7868-44be-9687-650162fd8309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920746717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3368b9-78a5-486c-86d2-062f449a3de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:01Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d1cda8-03cf-4ecc-bea8-350ae7c73162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d1cda8-03cf-4ecc-bea8-350ae7c73162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b5c70-6007-4ee3-a716-dc2b2e7fc735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b5c70-6007-4ee3-a716-dc2b2e7fc735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3368b9-78a5-486c-86d2-062f449a3de4', 'volume_name': 'volume-3b3368b9-78a5-486c-86d2-062f449a3de4', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6302ae2d-fdf7-4310-aa61-ffc155771f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6302ae2d-fdf7-4310-aa61-ffc155771f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff962e3f-55c6-4c30-8e1c-bf4e90027c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:01 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Volume 3b3368b9-78a5-486c-86d2-062f449a3de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3368b9-78a5-486c-86d2-062f449a3de4', 'volume_size': 1}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:01 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 1G" returned: 0 in 0.589s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a078f1dd-383b-4159-8012-8f377f215ac1 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:01 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a078f1dd-383b-4159-8012-8f377f215ac1 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08
Sep 09 13:24:01 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:01 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a078f1dd-383b-4159-8012-8f377f215ac1 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:01 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:01 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08
Sep 09 13:24:01 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:01 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08" returned: 0 in 0.268s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:01 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info
Sep 09 13:24:01 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:02 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:02 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:02 devstack sudo[101397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info
Sep 09 13:24:02 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:02 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.info" returned: 0 in 0.361s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920746717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3368b9-78a5-486c-86d2-062f449a3de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e08fc09e66c4b79a5e7def6b9fac6e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:01Z,use_quota=True,user_id='67e55cf03cfb4608a06221e2bd993be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Creating volume 3b3368b9-78a5-486c-86d2-062f449a3de4 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:02 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:02 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 1073741824
Sep 09 13:24:02 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-49f26e1b-651c-492a-9b98-28abf1c9605a tempest-GroupSnapshotsV319Test-830618186 None] group_snapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: created successfully
Sep 09 13:24:03 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 1073741824" returned: 0 in 0.550s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:03 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4
Sep 09 13:24:03 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:03 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4" returned: 0 in 0.418s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff962e3f-55c6-4c30-8e1c-bf4e90027c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3368b9-78a5-486c-86d2-062f449a3de4', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d02321-9fd6-4bc9-af2b-f7f61c74ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Volume volume-3b3368b9-78a5-486c-86d2-062f449a3de4 (3b3368b9-78a5-486c-86d2-062f449a3de4): created successfully
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d02321-9fd6-4bc9-af2b-f7f61c74ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Flow 'volume_create_manager' (23b335bd-0d0e-4b78-ac55-fb1e4012ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4461a0cc-c902-4a2d-9f9c-4a35524c0aa1 tempest-ProjectReaderTests-279736192 None] Created volume successfully.
Sep 09 13:24:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] group_snapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: deleting
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] group_snapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: deleting {{(pid=87606) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "cinder-quobyte-3c7ad590-179a-4f1d-afea-18287b059c08" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-3c7ad590-179a-4f1d-afea-18287b059c08" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Deleting offline snapshot 3c7ad590-179a-4f1d-afea-18287b059c08 of volume a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] snapshot_file for this snap is: volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[784316b0-9108-417e-ae66-bedf2fe3b204]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:04 devstack sudo[101409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08
Sep 09 13:24:04 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-3b3368b9-78a5-486c-86d2-062f449a3de4-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "cinder-3b3368b9-78a5-486c-86d2-062f449a3de4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Acquiring lock "cinder-quobyte-3b3368b9-78a5-486c-86d2-062f449a3de4" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-3b3368b9-78a5-486c-86d2-062f449a3de4" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:04 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08" returned: 0 in 0.685s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a078f1dd-383b-4159-8012-8f377f215ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf8564-fa1f-4c3d-83b0-11b2ea646d93]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65b65f-e0fb-4e36-be1a-089fc6eaac0a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:04 devstack sudo[101417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4
Sep 09 13:24:04 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:04 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1
Sep 09 13:24:04 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:05 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:05 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4" returned: 0 in 0.565s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1" returned: 0 in 0.560s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:05 devstack sudo[101435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4
Sep 09 13:24:05 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:05 devstack sudo[101436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08
Sep 09 13:24:05 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-d5d689ae-eac5-4e5a-88ae-021fc3898e9c req-654f3a8f-5407-43c7-8531-1cddb608454c tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-d5d689ae-eac5-4e5a-88ae-021fc3898e9c req-654f3a8f-5407-43c7-8531-1cddb608454c tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-d5d689ae-eac5-4e5a-88ae-021fc3898e9c req-654f3a8f-5407-43c7-8531-1cddb608454c tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-d5d689ae-eac5-4e5a-88ae-021fc3898e9c req-654f3a8f-5407-43c7-8531-1cddb608454c tempest-TestServerVolumeAttachmentScenario-917796865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-6684b201-fcba-40d1-af50-ed854757c468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0aa8034-a998-4c4e-a320-ddc88b5f255c', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:24:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-d5d689ae-eac5-4e5a-88ae-021fc3898e9c req-654f3a8f-5407-43c7-8531-1cddb608454c tempest-TestServerVolumeAttachmentScenario-917796865 None] attachment_update completed successfully.
Sep 09 13:24:05 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3b3368b9-78a5-486c-86d2-062f449a3de4" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "cinder-quobyte-3b3368b9-78a5-486c-86d2-062f449a3de4" released by "delete_volume" :: held 0.999s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Created reservations ['5fdc67bc-81c4-4338-a898-fe010d1c93c7', '488cc937-cbe1-44e9-82f3-a8175ee8695a', '00691903-a3a8-40b6-bfaf-829c63dfa183', '28cd5cb0-4acf-47f0-be89-916d47eaeaa0'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:05 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08" returned: 0 in 0.569s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:05 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:05 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:05 devstack sudo[101447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08
Sep 09 13:24:05 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:06 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1.3c7ad590-179a-4f1d-afea-18287b059c08" returned: 0 in 0.368s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:06 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.435s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-3c7ad590-179a-4f1d-afea-18287b059c08" released by "_delete_snapshot" :: held 2.366s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Deleted volume successfully.
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" released by "delete_snapshot" :: held 2.407s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-97bae5c3-a5a8-4cef-ae82-292fc41fecbf tempest-ProjectReaderTests-279736192 None] Lock "cinder-3b3368b9-78a5-486c-86d2-062f449a3de4-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:06 devstack cinder-volume[87606]: WARNING cinder.quota [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-308363294 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-308363294, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:06 devstack cinder-volume[87606]: WARNING cinder.quota [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-308363294 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-308363294, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:06 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] Created reservations ['f53a33a2-8382-4a19-9ce7-460d274a8229', 'e97827f3-3b5e-45ce-b07e-6b8da5519e1e', 'a0182c10-a655-46e7-8440-3b185a46e59d', '0197dd53-14a1-40f6-a07c-1164005330ce'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-67cf3176-00a3-446d-b73f-3b9f5a5e0ae6 tempest-GroupSnapshotsV319Test-830618186 None] group_snapshot 1a1ba7bc-e082-4838-8133-a602ab333fd1: deleted successfully
Sep 09 13:24:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f3773-cf9f-40fb-af51-bc15c91d1488]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:07 devstack sudo[101452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1
Sep 09 13:24:07 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:08 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1" returned: 0 in 0.545s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:08 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1
Sep 09 13:24:08 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-008d3231-b894-4aba-9e4a-ec6618a3b37f req-12015f76-1ff3-4994-8fa1-ee4eb194bf81 tempest-TestServerVolumeAttachmentScenario-917796865 None] Terminate volume connection completed successfully.
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-008d3231-b894-4aba-9e4a-ec6618a3b37f req-12015f76-1ff3-4994-8fa1-ee4eb194bf81 tempest-TestServerVolumeAttachmentScenario-917796865 None] Deleting attachment d0aa8034-a998-4c4e-a320-ddc88b5f255c. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:24:08 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a078f1dd-383b-4159-8012-8f377f215ac1" returned: 0 in 0.356s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Lock "cinder-quobyte-a078f1dd-383b-4159-8012-8f377f215ac1" released by "delete_volume" :: held 1.081s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Created reservations ['dbe1d4c6-e2b0-4e86-9278-5327c9d2ad2e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:08 devstack cinder-volume[87606]: WARNING cinder.quota [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-308363294 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-308363294, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Created reservations ['7c96bbdc-1ef6-4c64-886f-9c803b41889e', '7576bfba-6bdf-440a-9d8e-771ec06b2d3a', '9d02c32c-73ab-4bc6-bc39-dd54964f6021', 'cd3465bd-30d9-451b-af0a-6ac4ca9f24ca'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:09 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:09 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:09 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.393s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:09 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0d49b46b-6cef-4fec-a026-c07d2120b57d tempest-GroupSnapshotsV319Test-830618186 None] Delete group completed successfully.
Sep 09 13:24:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-109484ce-77fb-471a-9f35-7c83e7e41d6c req-d739f588-1c32-4c39-a258-c915023c3691 tempest-TestServerVolumeAttachmentScenario-917796865 None] Terminate volume connection completed successfully.
Sep 09 13:24:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-109484ce-77fb-471a-9f35-7c83e7e41d6c req-d739f588-1c32-4c39-a258-c915023c3691 tempest-TestServerVolumeAttachmentScenario-917796865 None] Deleting attachment 20d6213f-61f4-420c-bc90-c842856107a5. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Flow 'volume_create_manager' (7159df0d-3565-4745-8ba7-2ca605c45a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81086f2-52ac-44e5-a7fd-f66681baaae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81086f2-52ac-44e5-a7fd-f66681baaae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1950549670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f107da-8ebd-4328-bc90-1946ba0690a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7df38b0fd51465b9f47dd00f6b8e896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:14Z,use_quota=True,user_id='5d6d8e8cae7748d8b94e4c8a4c55280b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf982092-463f-46a3-bcb2-423c9aef5180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf982092-463f-46a3-bcb2-423c9aef5180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd5266-2e29-4e41-bd08-0d9161a45a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:13 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd5266-2e29-4e41-bd08-0d9161a45a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24f107da-8ebd-4328-bc90-1946ba0690a5', 'volume_name': 'volume-24f107da-8ebd-4328-bc90-1946ba0690a5', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8e4e0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a390a-db87-4c37-8be4-db028b3913d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a390a-db87-4c37-8be4-db028b3913d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b821c44-a362-4e0f-86a2-36e735ab5bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:14 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Volume 24f107da-8ebd-4328-bc90-1946ba0690a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24f107da-8ebd-4328-bc90-1946ba0690a5', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8e4e0>}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Trying to clone 24f107da-8ebd-4328-bc90-1946ba0690a5 from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:24:14 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Image download 20.69 MB at 20.69 MB/s
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ee437-f246-46ed-8ec3-e5f1175b597e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:15 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD
Sep 09 13:24:15 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:15 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 is fetched for user 5d6d8e8cae7748d8b94e4c8a4c55280b. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "cinder-6684b201-fcba-40d1-af50-ed854757c468-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-6684b201-fcba-40d1-af50-ed854757c468-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cac953-713d-4a70-9075-4fdb08ad345e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "cinder-quobyte-6684b201-fcba-40d1-af50-ed854757c468" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-quobyte-6684b201-fcba-40d1-af50-ed854757c468" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daae03c-433c-4625-9084-598d889ea0e0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:15 devstack sudo[101526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD
Sep 09 13:24:15 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:15 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468
Sep 09 13:24:15 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:15 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1950549670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f107da-8ebd-4328-bc90-1946ba0690a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7df38b0fd51465b9f47dd00f6b8e896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:14Z,use_quota=True,user_id='5d6d8e8cae7748d8b94e4c8a4c55280b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Creating volume 24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:15 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:15 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1073741824
Sep 09 13:24:15 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:15 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468" returned: 0 in 0.403s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:15 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468
Sep 09 13:24:15 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:16 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6684b201-fcba-40d1-af50-ed854757c468" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-quobyte-6684b201-fcba-40d1-af50-ed854757c468" released by "delete_volume" :: held 0.719s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Created reservations ['efe998f2-c6ed-4a80-b651-49f677c8e053', 'dbfa39f9-c00e-408f-b7d5-d87a1e10ffa3', '3fbacaaf-f430-4423-bc1a-11c63a06f198', '1d3d689e-d8d3-4a86-89f3-aba452fb0e70'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:16 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1073741824" returned: 0 in 0.499s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:16 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:16 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:16 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5
Sep 09 13:24:16 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "cinder-c1341a8f-081a-4518-bd7e-f080f33b54df-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-c1341a8f-081a-4518-bd7e-f080f33b54df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:16 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "cinder-quobyte-c1341a8f-081a-4518-bd7e-f080f33b54df" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.314s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Deleted volume successfully.
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-quobyte-c1341a8f-081a-4518-bd7e-f080f33b54df" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0f9da87d-3651-464c-b9f0-0489d050286b tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-6684b201-fcba-40d1-af50-ed854757c468-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0193eef-8f5e-4b77-afef-082337bc89d3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:16 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5" returned: 0 in 0.348s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Attempting download of 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 24f107da-8ebd-4328-bc90-1946ba0690a5. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1df50e-b6f2-4cb8-a713-9c888e23d380]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:16 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df
Sep 09 13:24:16 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:16 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18
Sep 09 13:24:17 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:17 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df" returned: 0 in 0.442s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:17 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df
Sep 09 13:24:17 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:17 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18" returned: 0 in 0.371s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:17 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18
Sep 09 13:24:17 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:17 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1341a8f-081a-4518-bd7e-f080f33b54df" returned: 0 in 0.275s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-quobyte-c1341a8f-081a-4518-bd7e-f080f33b54df" released by "delete_volume" :: held 0.778s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Created reservations ['7a0acb89-71a3-4355-b560-7208861b8e12', '8153293a-611c-4d0c-8e0f-31938cd04a3d', '9be98553-3b79-461e-b25c-58ea788179c8', 'b8600af0-2abf-4b3b-849b-e74613b0cdbe'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:17 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18" returned: 1 in 0.356s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a0fc37-23e8-4a61-8370-95b767ddcca5_ez_6bl18' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff3f19-1c0a-425f-baee-758a618d2776]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:17 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:17 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:17 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD
Sep 09 13:24:17 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:17 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.292s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:17 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:17 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Deleted volume successfully.
Sep 09 13:24:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d2da8667-10d9-4c4c-8322-db7a8c23b4d1 tempest-TestServerVolumeAttachmentScenario-917796865 None] Lock "cinder-c1341a8f-081a-4518-bd7e-f080f33b54df-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:18 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:18 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] 11a0fc37-23e8-4a61-8370-95b767ddcca5 was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:24:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:18 devstack sudo[101575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5
Sep 09 13:24:18 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:20 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5" returned: 0 in 2.129s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a0fc37-23e8-4a61-8370-95b767ddcca5_3ga6awqwdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:24:20 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Converted 112.00 MB image at 52.56 MB/s
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:20 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1G
Sep 09 13:24:20 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:20 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 1G" returned: 0 in 0.391s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Downloaded image 11a0fc37-23e8-4a61-8370-95b767ddcca5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}])) to volume 24f107da-8ebd-4328-bc90-1946ba0690a5 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Temporary image 11a0fc37-23e8-4a61-8370-95b767ddcca5 for user 5d6d8e8cae7748d8b94e4c8a4c55280b is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Marking volume 24f107da-8ebd-4328-bc90-1946ba0690a5 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Copying metadata from image 11a0fc37-23e8-4a61-8370-95b767ddcca5 to 24f107da-8ebd-4328-bc90-1946ba0690a5. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Creating volume glance metadata for volume 24f107da-8ebd-4328-bc90-1946ba0690a5 backed by image 11a0fc37-23e8-4a61-8370-95b767ddcca5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b821c44-a362-4e0f-86a2-36e735ab5bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f107da-8ebd-4328-bc90-1946ba0690a5', 'volume_size': 1, 'image_id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a0fc37-23e8-4a61-8370-95b767ddcca5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ac5f1c1db6bb437285a5860a2858ab86', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a0fc37-23e8-4a61-8370-95b767ddcca5', 'created_at': datetime.datetime(2026, 9, 9, 11, 6, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 6, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a0fc37-23e8-4a61-8370-95b767ddcca5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8e4e0>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c87c8-08c2-4fe3-bf7d-9fb61f880250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Volume volume-24f107da-8ebd-4328-bc90-1946ba0690a5 (24f107da-8ebd-4328-bc90-1946ba0690a5): created successfully
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234c87c8-08c2-4fe3-bf7d-9fb61f880250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Flow 'volume_create_manager' (7159df0d-3565-4745-8ba7-2ca605c45a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ff435939-ec3b-49b8-87f7-988609d5e93c tempest-TestShelveInstance-1137941889 None] Created volume successfully.
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=170,cinder:SELECT=159,cinder:INSERT=48,cinder:DELETE=7 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=179,cinder:SELECT=162,cinder:DELETE=11,cinder:INSERT=48 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cf2b40b4-4dbe-4d0f-946a-77a68ba46749 req-983f8ed7-9f65-420a-8f3b-60dd7d181349 tempest-TestShelveInstance-1137941889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cf2b40b4-4dbe-4d0f-946a-77a68ba46749 req-983f8ed7-9f65-420a-8f3b-60dd7d181349 tempest-TestShelveInstance-1137941889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-cf2b40b4-4dbe-4d0f-946a-77a68ba46749 req-983f8ed7-9f65-420a-8f3b-60dd7d181349 tempest-TestShelveInstance-1137941889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-cf2b40b4-4dbe-4d0f-946a-77a68ba46749 req-983f8ed7-9f65-420a-8f3b-60dd7d181349 tempest-TestShelveInstance-1137941889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-24f107da-8ebd-4328-bc90-1946ba0690a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5182883c-da1e-4238-af27-6210435d2aa0', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:24:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-cf2b40b4-4dbe-4d0f-946a-77a68ba46749 req-983f8ed7-9f65-420a-8f3b-60dd7d181349 tempest-TestShelveInstance-1137941889 None] attachment_update completed successfully.
Sep 09 13:24:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-159b54a3-fafd-417d-bd31-010b7814c80b tempest-GroupsTest-427400292 None] Group tempest-Group1-1570155704: creating
Sep 09 13:24:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-159b54a3-fafd-417d-bd31-010b7814c80b tempest-GroupsTest-427400292 None] Group tempest-Group1-1570155704: created successfully
Sep 09 13:24:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-159b54a3-fafd-417d-bd31-010b7814c80b tempest-GroupsTest-427400292 None] Create group completed successfully.
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:25 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:25 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:25 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.306s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:24:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:24:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8029817d-9247-4093-9a49-8e72fe7398d7 tempest-GroupsTest-427400292 None] Group tempest-Group2-655241051: creating
Sep 09 13:24:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8029817d-9247-4093-9a49-8e72fe7398d7 tempest-GroupsTest-427400292 None] Group tempest-Group2-655241051: created successfully
Sep 09 13:24:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8029817d-9247-4093-9a49-8e72fe7398d7 tempest-GroupsTest-427400292 None] Create group completed successfully.
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (3917c78d-c77f-4795-a5df-0b86c23d2c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd71ecc-996d-4e88-8bc1-20c5cd569e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd71ecc-996d-4e88-8bc1-20c5cd569e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1675227939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eae6a392-e638-440b-bd5d-7e027b3d6571,host='devstack@QuobyteHD#QuobyteHD',id=ebf791d8-13fb-4448-b5e3-902203d6e447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:29Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fbd647c-f6b7-4e6d-9728-300f8cfd2ac7),volume_type_id=3fbd647c-f6b7-4e6d-9728-300f8cfd2ac7)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f17f495-e184-46a8-8ccc-3a6980b667d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f17f495-e184-46a8-8ccc-3a6980b667d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74158c2c-75e7-4312-85e6-4df45d4b086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74158c2c-75e7-4312-85e6-4df45d4b086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf791d8-13fb-4448-b5e3-902203d6e447', 'volume_name': 'volume-ebf791d8-13fb-4448-b5e3-902203d6e447', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69fcba5-1318-49c6-8617-26acf3f546fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69fcba5-1318-49c6-8617-26acf3f546fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b753b0e-1f0c-44a7-ab82-6d3976b15ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Volume ebf791d8-13fb-4448-b5e3-902203d6e447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf791d8-13fb-4448-b5e3-902203d6e447', 'volume_size': 1}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eae6a392-e638-440b-bd5d-7e027b3d6571,created_at=2026-09-09T11:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1675227939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eae6a392-e638-440b-bd5d-7e027b3d6571,host='devstack@QuobyteHD#QuobyteHD',id=ebf791d8-13fb-4448-b5e3-902203d6e447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:29Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fbd647c-f6b7-4e6d-9728-300f8cfd2ac7),volume_type_id=3fbd647c-f6b7-4e6d-9728-300f8cfd2ac7)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Creating volume ebf791d8-13fb-4448-b5e3-902203d6e447 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:29 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:29 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 1073741824
Sep 09 13:24:29 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:29 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 1073741824" returned: 0 in 0.711s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:29 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447
Sep 09 13:24:29 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:30 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447" returned: 0 in 0.419s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b753b0e-1f0c-44a7-ab82-6d3976b15ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf791d8-13fb-4448-b5e3-902203d6e447', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e0895-1e51-4b8d-baa8-46a11d67b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Volume volume-ebf791d8-13fb-4448-b5e3-902203d6e447 (ebf791d8-13fb-4448-b5e3-902203d6e447): created successfully
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e0895-1e51-4b8d-baa8-46a11d67b40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (3917c78d-c77f-4795-a5df-0b86c23d2c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fae5df48-1806-4766-84a1-73611ae4558c tempest-GroupsTest-427400292 None] Created volume successfully.
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Acquiring lock "cinder-quobyte-ebf791d8-13fb-4448-b5e3-902203d6e447" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-ebf791d8-13fb-4448-b5e3-902203d6e447" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48685a-5325-47f3-88fb-2d298b07ef5f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:32 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447
Sep 09 13:24:32 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:32 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447" returned: 0 in 0.560s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:32 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447
Sep 09 13:24:32 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:33 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ebf791d8-13fb-4448-b5e3-902203d6e447" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-ebf791d8-13fb-4448-b5e3-902203d6e447" released by "delete_volume" :: held 1.056s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Created reservations ['88ae84f6-18ec-4feb-a382-acc20bd272d0'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:33 devstack cinder-volume[87606]: WARNING cinder.quota [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1818427556 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1818427556, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:33 devstack cinder-volume[87606]: WARNING cinder.quota [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1818427556 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1818427556, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Created reservations ['0e75e74e-8c48-4c5e-b4f1-9367a6246abe', '98348278-e45a-4da8-92fb-1b43d3fc5a5b', '2d4be8bf-7595-4579-82e5-a871b63c6379', '99b8d017-09cf-44f7-ba85-1f464a0fb6c4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:33 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:33 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:34 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:34 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8d4ddb95-d7ef-45a6-be4e-1949abc81f75 tempest-GroupsTest-427400292 None] Delete group completed successfully.
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Created reservations ['41dc8d1b-784d-4b54-a8f6-8dcc82c1a842'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:35 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:35 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:35 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:35 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4bfc0b97-9ee6-4fcf-af55-1aaad5afcfa5 tempest-GroupsTest-427400292 None] Delete group completed successfully.
Sep 09 13:24:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d2ffd556-b3cb-4173-abe4-3dd5021d8635 tempest-GroupsTest-427400292 None] Group tempest-GroupsTest-Group-301750401: creating
Sep 09 13:24:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d2ffd556-b3cb-4173-abe4-3dd5021d8635 tempest-GroupsTest-427400292 None] Group tempest-GroupsTest-Group-301750401: created successfully
Sep 09 13:24:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d2ffd556-b3cb-4173-abe4-3dd5021d8635 tempest-GroupsTest-427400292 None] Create group completed successfully.
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (57135331-de39-41a1-a9e6-34e296923a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ca99e-ee64-4c04-a52f-c23e67658606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ca99e-ee64-4c04-a52f-c23e67658606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150400272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,host='devstack@QuobyteHD#QuobyteHD',id=300c733c-d1c7-4ab4-bcd1-950adbd65894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:38Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573292fe-8be7-4147-b971-38cf34356b34),volume_type_id=573292fe-8be7-4147-b971-38cf34356b34)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bc4be6-9d8e-4555-bba2-faf1c640ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bc4be6-9d8e-4555-bba2-faf1c640ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccab717-dffb-4d86-9f19-55a5e80a033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccab717-dffb-4d86-9f19-55a5e80a033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300c733c-d1c7-4ab4-bcd1-950adbd65894', 'volume_name': 'volume-300c733c-d1c7-4ab4-bcd1-950adbd65894', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c01c6f-f8b2-4c8b-9344-c6602f7c72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c01c6f-f8b2-4c8b-9344-c6602f7c72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4544c448-e247-4c56-a6e3-8c4def066270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Volume 300c733c-d1c7-4ab4-bcd1-950adbd65894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300c733c-d1c7-4ab4-bcd1-950adbd65894', 'volume_size': 1}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,created_at=2026-09-09T11:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150400272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,host='devstack@QuobyteHD#QuobyteHD',id=300c733c-d1c7-4ab4-bcd1-950adbd65894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:38Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573292fe-8be7-4147-b971-38cf34356b34),volume_type_id=573292fe-8be7-4147-b971-38cf34356b34)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Creating volume 300c733c-d1c7-4ab4-bcd1-950adbd65894 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:38 devstack sudo[102127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 1073741824
Sep 09 13:24:38 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:39 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 1073741824" returned: 0 in 0.628s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:39 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894
Sep 09 13:24:39 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:39 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894" returned: 0 in 0.329s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4544c448-e247-4c56-a6e3-8c4def066270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300c733c-d1c7-4ab4-bcd1-950adbd65894', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79c82a3-e718-432e-aa1c-8bfbc4d95a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Volume volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 (300c733c-d1c7-4ab4-bcd1-950adbd65894): created successfully
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79c82a3-e718-432e-aa1c-8bfbc4d95a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (57135331-de39-41a1-a9e6-34e296923a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f5fc6ab7-7ad4-4072-9fca-d11a2df565df tempest-GroupsTest-427400292 None] Created volume successfully.
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (7f99af1b-fc1b-4d03-9e26-24a3a0cb82a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8662a1-5565-4189-972c-b1785c4430cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8662a1-5565-4189-972c-b1785c4430cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255746166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,host='devstack@QuobyteHD#QuobyteHD',id=f116a328-fab2-40a7-ab4a-fe35c30adc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:42Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573292fe-8be7-4147-b971-38cf34356b34),volume_type_id=573292fe-8be7-4147-b971-38cf34356b34)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdaaa31-f4e6-4c29-9b36-7249a667b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdaaa31-f4e6-4c29-9b36-7249a667b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6bae27-49ce-4fd4-a594-824c50e1fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6bae27-49ce-4fd4-a594-824c50e1fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f116a328-fab2-40a7-ab4a-fe35c30adc71', 'volume_name': 'volume-f116a328-fab2-40a7-ab4a-fe35c30adc71', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7507b3c5-1245-4b5e-a242-ec7774b7f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7507b3c5-1245-4b5e-a242-ec7774b7f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610a7c8b-07d2-4b31-b088-deafedfa59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Volume f116a328-fab2-40a7-ab4a-fe35c30adc71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f116a328-fab2-40a7-ab4a-fe35c30adc71', 'volume_size': 1}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,created_at=2026-09-09T11:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255746166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dccb7b4b-20eb-428b-98cc-ad3175abbf52,host='devstack@QuobyteHD#QuobyteHD',id=f116a328-fab2-40a7-ab4a-fe35c30adc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4662a0eb26e645acab846f4abe079f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:42Z,use_quota=True,user_id='7c15a083df374e91bec665766fb5de41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573292fe-8be7-4147-b971-38cf34356b34),volume_type_id=573292fe-8be7-4147-b971-38cf34356b34)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Creating volume f116a328-fab2-40a7-ab4a-fe35c30adc71 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:41 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 1073741824
Sep 09 13:24:41 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:42 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 1073741824" returned: 0 in 0.536s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:42 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71
Sep 09 13:24:42 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:42 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610a7c8b-07d2-4b31-b088-deafedfa59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f116a328-fab2-40a7-ab4a-fe35c30adc71', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d0b0c0-d760-4f0d-a66c-c11996c63e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:42 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Volume volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 (f116a328-fab2-40a7-ab4a-fe35c30adc71): created successfully
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d0b0c0-d760-4f0d-a66c-c11996c63e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Flow 'volume_create_manager' (7f99af1b-fc1b-4d03-9e26-24a3a0cb82a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7bd56df0-2cd6-483d-96de-302f32aa7cbd tempest-GroupsTest-427400292 None] Created volume successfully.
Sep 09 13:24:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3c9699fe-30d4-40c2-b262-feec3fe3e43e tempest-GroupsTest-427400292 None] Update group completed successfully.
Sep 09 13:24:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e5085ee9-56e3-4139-86f4-78f7d9757ebe tempest-GroupsTest-427400292 None] Update group completed successfully.
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Acquiring lock "cinder-quobyte-300c733c-d1c7-4ab4-bcd1-950adbd65894" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-300c733c-d1c7-4ab4-bcd1-950adbd65894" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c94fa8-3d65-420b-93f9-a1a5ef48e82a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:46 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894
Sep 09 13:24:46 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:46 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894" returned: 0 in 0.429s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:46 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894
Sep 09 13:24:46 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:47 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-300c733c-d1c7-4ab4-bcd1-950adbd65894" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-300c733c-d1c7-4ab4-bcd1-950adbd65894" released by "delete_volume" :: held 0.771s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Acquiring lock "cinder-quobyte-f116a328-fab2-40a7-ab4a-fe35c30adc71" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-f116a328-fab2-40a7-ab4a-fe35c30adc71" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed65d23-5a17-49cb-a0e1-d7b9556ee2df]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:47 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71
Sep 09 13:24:47 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:47 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71" returned: 0 in 0.444s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:47 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71
Sep 09 13:24:47 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:47 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f116a328-fab2-40a7-ab4a-fe35c30adc71" returned: 0 in 0.298s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "cinder-quobyte-f116a328-fab2-40a7-ab4a-fe35c30adc71" released by "delete_volume" :: held 0.795s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Created reservations ['86425378-da40-4e37-88d8-bfe84f8ae92c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:48 devstack cinder-volume[87606]: WARNING cinder.quota [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-221114035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-221114035, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:48 devstack cinder-volume[87606]: WARNING cinder.quota [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-221114035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-221114035, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Created reservations ['4e37929a-989c-49ee-8c26-450066fa5514', '511518ac-4afe-410f-bbbb-018e3ff9f97c', '2caf90d4-1055-4e2c-9330-c65402c4c632', '3626c3f4-eef7-4236-b96e-186e232165ed'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Created reservations ['59e1487f-f8f9-488f-84af-a60b0813dccb', '8b177b6d-2355-42d1-99a0-e9b0fa1fc01a', '4da5e7e5-ed05-4bbb-aa8e-0b35da0a86cc', 'e33f6769-1052-43ea-b9fa-7852194c0375'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:48 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:24:48 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:48 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:48 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:24:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1cdaf65b-afe2-4179-a5b8-fb0bc070e622 tempest-GroupsTest-427400292 None] Delete group completed successfully.
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Flow 'volume_create_manager' (66f1ee1e-1e71-4901-a4e3-3fc858564a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5daeb3a-61ae-451f-82fb-265df73c55ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5daeb3a-61ae-451f-82fb-265df73c55ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1112802216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4301d016-a9d1-4c93-b84a-7f4c97312165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f5c9b2f1ba4cedab3cc0029b4d9fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:56Z,use_quota=True,user_id='eee95ba2bf4f457fa14d4a0e29d6379a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a04717-5d45-476f-b94a-9e9f40e10294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a04717-5d45-476f-b94a-9e9f40e10294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c6b8a3-4112-4f60-b5d9-c1cd1434b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c6b8a3-4112-4f60-b5d9-c1cd1434b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4301d016-a9d1-4c93-b84a-7f4c97312165', 'volume_name': 'volume-4301d016-a9d1-4c93-b84a-7f4c97312165', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271e0aaa-7737-4279-b650-77cced17c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271e0aaa-7737-4279-b650-77cced17c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b63f671-436e-4953-8f49-be23aa749d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Volume 4301d016-a9d1-4c93-b84a-7f4c97312165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4301d016-a9d1-4c93-b84a-7f4c97312165', 'volume_size': 1}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1112802216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4301d016-a9d1-4c93-b84a-7f4c97312165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f5c9b2f1ba4cedab3cc0029b4d9fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:24:56Z,use_quota=True,user_id='eee95ba2bf4f457fa14d4a0e29d6379a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Creating volume 4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:24:55 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:24:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:55 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 1073741824
Sep 09 13:24:56 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:56 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 1073741824" returned: 0 in 0.514s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:56 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:24:56 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:56 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b63f671-436e-4953-8f49-be23aa749d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4301d016-a9d1-4c93-b84a-7f4c97312165', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d85769-5921-4fdf-b28b-691e1fdff3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:24:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Volume volume-4301d016-a9d1-4c93-b84a-7f4c97312165 (4301d016-a9d1-4c93-b84a-7f4c97312165): created successfully
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d85769-5921-4fdf-b28b-691e1fdff3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:24:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Flow 'volume_create_manager' (66f1ee1e-1e71-4901-a4e3-3fc858564a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:24:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4ec92d03-5e1d-4586-a310-c06056dde18b tempest-TestImageHashVerification-1317657485 None] Created volume successfully.
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f537c-dc47-49d2-b07f-0e344f19a442]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:59 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:24:59 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:59 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.381s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9042e-0398-4290-a46a-0c63fa1b89c8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:59 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:24:59 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:24:59 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:24:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 /opt/stack/data/cinder/conversion/4301d016-a9d1-4c93-b84a-7f4c97312165.temp_image.911edaca-7c84-44a5-a844-7b49966f36c5zfppq1ju.img {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:24:59 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 /opt/stack/data/cinder/conversion/4301d016-a9d1-4c93-b84a-7f4c97312165.temp_image.911edaca-7c84-44a5-a844-7b49966f36c5zfppq1ju.img
Sep 09 13:24:59 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-06251f1b-7a53-45d8-b247-80f8b206ea5d req-12ec8000-9411-46f9-9eed-55bf1978f179 tempest-TestShelveInstance-1137941889 None] Terminate volume connection completed successfully.
Sep 09 13:25:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-06251f1b-7a53-45d8-b247-80f8b206ea5d req-12ec8000-9411-46f9-9eed-55bf1978f179 tempest-TestShelveInstance-1137941889 None] Deleting attachment 5182883c-da1e-4238-af27-6210435d2aa0. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:25:05 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 /opt/stack/data/cinder/conversion/4301d016-a9d1-4c93-b84a-7f4c97312165.temp_image.911edaca-7c84-44a5-a844-7b49966f36c5zfppq1ju.img" returned: 0 in 5.928s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dca0af9-fdc3-45a8-a438-a3536949c88e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:05 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:25:05 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:06 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.607s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:06 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/conversion/4301d016-a9d1-4c93-b84a-7f4c97312165.temp_image.911edaca-7c84-44a5-a844-7b49966f36c5zfppq1ju.img {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:25:06 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Converted 1024.00 MB image at 172.62 MB/s
Sep 09 13:25:06 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] 911edaca-7c84-44a5-a844-7b49966f36c5 was raw, no need to convert to raw {{(pid=87606) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 09 13:25:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-86be840a-f238-4a30-a7a2-50ef952aa730 req-03fa8a91-23c1-43df-a257-0f5edfbf07ac tempest-TestShelveInstance-1137941889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Flow 'volume_create_manager' (9204fd00-9fef-4e7f-9206-6b75a0df6cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5953c86-78cd-4b05-b9a1-854aae471e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5953c86-78cd-4b05-b9a1-854aae471e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1135544149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad6dd17-2135-4774-840f-b48d269c329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a142997f4164fe7987d1c404031303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:17Z,use_quota=True,user_id='0142f6d5fc054d57b0a62c5aae7aed02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c531d42c-50e8-4742-bbfa-395c9f1578ac),volume_type_id=c531d42c-50e8-4742-bbfa-395c9f1578ac)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44684172-1b12-454f-bcf9-1faac23ab647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44684172-1b12-454f-bcf9-1faac23ab647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f086404-713a-485e-be97-0d1205aa886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f086404-713a-485e-be97-0d1205aa886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad6dd17-2135-4774-840f-b48d269c329e', 'volume_name': 'volume-9ad6dd17-2135-4774-840f-b48d269c329e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfc5d8a-33d9-4683-8f58-04747c4e23d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfc5d8a-33d9-4683-8f58-04747c4e23d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858b2578-3117-495c-aec5-d92c9da8d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:16 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Volume 9ad6dd17-2135-4774-840f-b48d269c329e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad6dd17-2135-4774-840f-b48d269c329e', 'volume_size': 1}
Sep 09 13:25:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:25 devstack sudo[102748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:25 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:25 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:25:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.116s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Uploaded volume to glance image-id: 911edaca-7c84-44a5-a844-7b49966f36c5. {{(pid=87606) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-86be840a-f238-4a30-a7a2-50ef952aa730 req-03fa8a91-23c1-43df-a257-0f5edfbf07ac tempest-TestShelveInstance-1137941889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.666s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=52,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=49,cinder:SELECT=56,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-86be840a-f238-4a30-a7a2-50ef952aa730 req-03fa8a91-23c1-43df-a257-0f5edfbf07ac tempest-TestShelveInstance-1137941889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.375s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1135544149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad6dd17-2135-4774-840f-b48d269c329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a142997f4164fe7987d1c404031303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:17Z,use_quota=True,user_id='0142f6d5fc054d57b0a62c5aae7aed02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c531d42c-50e8-4742-bbfa-395c9f1578ac),volume_type_id=c531d42c-50e8-4742-bbfa-395c9f1578ac)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Creating volume 9ad6dd17-2135-4774-840f-b48d269c329e {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a1d13d5e-64ca-42e8-8fc5-eb44ba8a943c tempest-TestImageHashVerification-1317657485 None] Copy volume to image completed successfully.
Sep 09 13:25:26 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e 1073741824
Sep 09 13:25:26 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-86be840a-f238-4a30-a7a2-50ef952aa730 req-03fa8a91-23c1-43df-a257-0f5edfbf07ac tempest-TestShelveInstance-1137941889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-24f107da-8ebd-4328-bc90-1946ba0690a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5787426e-cceb-4d51-97fd-687fdead0ac5', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:25:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-86be840a-f238-4a30-a7a2-50ef952aa730 req-03fa8a91-23c1-43df-a257-0f5edfbf07ac tempest-TestShelveInstance-1137941889 None] attachment_update completed successfully.
Sep 09 13:25:26 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e 1073741824" returned: 0 in 0.535s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:26 devstack sudo[102756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e
Sep 09 13:25:26 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Acquiring lock "cinder-4301d016-a9d1-4c93-b84a-7f4c97312165-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "cinder-4301d016-a9d1-4c93-b84a-7f4c97312165-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Acquiring lock "cinder-quobyte-4301d016-a9d1-4c93-b84a-7f4c97312165" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "cinder-quobyte-4301d016-a9d1-4c93-b84a-7f4c97312165" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8df5cd-5726-48ff-a605-59c39d10a1d9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:27 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e" returned: 0 in 0.286s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858b2578-3117-495c-aec5-d92c9da8d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad6dd17-2135-4774-840f-b48d269c329e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2399b1f-7550-4622-acd9-ed876c0d917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Volume volume-9ad6dd17-2135-4774-840f-b48d269c329e (9ad6dd17-2135-4774-840f-b48d269c329e): created successfully
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2399b1f-7550-4622-acd9-ed876c0d917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Flow 'volume_create_manager' (9204fd00-9fef-4e7f-9206-6b75a0df6cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2b59c951-c91d-43cb-90a6-100e52481af8 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Created volume successfully.
Sep 09 13:25:27 devstack sudo[102759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:25:27 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:27 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.414s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:27 devstack sudo[102764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165
Sep 09 13:25:27 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:27 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4301d016-a9d1-4c93-b84a-7f4c97312165" returned: 0 in 0.344s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "cinder-quobyte-4301d016-a9d1-4c93-b84a-7f4c97312165" released by "delete_volume" :: held 0.798s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:27 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:27 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Created reservations ['b2297233-447e-4ba5-8e95-da256ac79f8a', 'ea58ea46-cd8a-4cac-89f5-c791daad4bb7', '10d4361c-0606-4b95-b178-773a8b130c60', '65a39ae2-2991-4156-b78f-e75735b22bfc'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:28 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:28 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:28 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:28 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c9508a62-8f57-45ff-8bae-88756e30c9f1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Retype volume completed successfully.
Sep 09 13:25:28 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:28 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Deleted volume successfully.
Sep 09 13:25:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1ff4237d-fa40-4fe8-8166-dc5263650e6a tempest-TestImageHashVerification-1317657485 None] Lock "cinder-4301d016-a9d1-4c93-b84a-7f4c97312165-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "cinder-9ad6dd17-2135-4774-840f-b48d269c329e-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "cinder-9ad6dd17-2135-4774-840f-b48d269c329e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "cinder-quobyte-9ad6dd17-2135-4774-840f-b48d269c329e" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "cinder-quobyte-9ad6dd17-2135-4774-840f-b48d269c329e" acquired by "delete_volume" :: waited 0.042s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd5b33d-035e-4c70-a68e-af43768de486]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:29 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e
Sep 09 13:25:29 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:30 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e" returned: 0 in 0.656s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:30 devstack sudo[103212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e
Sep 09 13:25:30 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:30 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ad6dd17-2135-4774-840f-b48d269c329e" returned: 0 in 0.600s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "cinder-quobyte-9ad6dd17-2135-4774-840f-b48d269c329e" released by "delete_volume" :: held 1.378s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:30 devstack cinder-volume[87606]: WARNING cinder.quota [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:25:30 devstack cinder-volume[87606]: WARNING cinder.quota [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Created reservations ['ebee9a6d-9a04-445c-9513-8e1aabdeb290', '3876044b-ac6c-4769-8714-64a9e9440d08', '99e7b242-ef6c-45d8-8d88-13dd05eaaf7b', '10597645-0a75-4bb1-8f09-417d43d4a663'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:31 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:31 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:31 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.310s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:31 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Deleted volume successfully.
Sep 09 13:25:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-259bae4f-e37c-4510-81c0-82778f7677a1 tempest-VolumeRetypeWithoutMigrationTest-1006680783 None] Lock "cinder-9ad6dd17-2135-4774-840f-b48d269c329e-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:40 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:25:41 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=25,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (2e66205c-4d8a-4ad7-a584-9e0aaba3de74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c93c82-7548-4025-87ff-3e99f8523add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c93c82-7548-4025-87ff-3e99f8523add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849845403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440dfdd8-800d-4d6e-a717-8087fff68285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:44Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ba0b6a-e1b9-4673-8479-cf6f44d47981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ba0b6a-e1b9-4673-8479-cf6f44d47981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd17bad-e846-4698-9c99-a6d5dfd842ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd17bad-e846-4698-9c99-a6d5dfd842ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '440dfdd8-800d-4d6e-a717-8087fff68285', 'volume_name': 'volume-440dfdd8-800d-4d6e-a717-8087fff68285', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3021dd-af40-4ba0-9fb7-33ffb6aff4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3021dd-af40-4ba0-9fb7-33ffb6aff4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df2260e-085b-4f2e-bd0e-ef3707c25910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Volume 440dfdd8-800d-4d6e-a717-8087fff68285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-440dfdd8-800d-4d6e-a717-8087fff68285', 'volume_size': 1}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849845403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440dfdd8-800d-4d6e-a717-8087fff68285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:44Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Creating volume 440dfdd8-800d-4d6e-a717-8087fff68285 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:44 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:44 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 1073741824
Sep 09 13:25:44 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (bc45ef42-80ca-4849-954a-903563fbd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf3d6e-468b-455b-8a87-43864c53037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf3d6e-468b-455b-8a87-43864c53037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1164591774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:45Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7a8e80-065a-4401-b2b2-a2434dc8ea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7a8e80-065a-4401-b2b2-a2434dc8ea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd3dcef-2f9b-4ef7-a1e3-5d9870b6a0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd3dcef-2f9b-4ef7-a1e3-5d9870b6a0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff', 'volume_name': 'volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63d4c10-465d-4fc7-a3e3-f21d84a830e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63d4c10-465d-4fc7-a3e3-f21d84a830e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29196943-9767-4ed1-ade5-b243d247c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Volume ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff', 'volume_size': 1}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:45 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 1073741824" returned: 0 in 0.826s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:45 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285
Sep 09 13:25:45 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (99ec97f8-faf3-41a1-acae-5ae498377d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206cdc7a-da51-4486-96e2-27fa85914016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206cdc7a-da51-4486-96e2-27fa85914016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096418092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dcbe3b-d165-4e33-815e-d8924d446735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:45Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b417ae3f-67a1-4eb9-a176-2881761eaab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b417ae3f-67a1-4eb9-a176-2881761eaab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc08356f-45ea-421e-ac8e-1a0b15e06677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc08356f-45ea-421e-ac8e-1a0b15e06677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62dcbe3b-d165-4e33-815e-d8924d446735', 'volume_name': 'volume-62dcbe3b-d165-4e33-815e-d8924d446735', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912446e9-7df9-497b-90a7-9e6e4ce2ead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912446e9-7df9-497b-90a7-9e6e4ce2ead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5f0dd6-cde7-4df0-81a9-a0637a0a5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Volume 62dcbe3b-d165-4e33-815e-d8924d446735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62dcbe3b-d165-4e33-815e-d8924d446735', 'volume_size': 1}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:45 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1164591774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:45Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Creating volume ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:45 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:45 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff 1073741824
Sep 09 13:25:45 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df2260e-085b-4f2e-bd0e-ef3707c25910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-440dfdd8-800d-4d6e-a717-8087fff68285', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70536cfa-fbb0-4bf2-8b2c-482022c9b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Volume volume-440dfdd8-800d-4d6e-a717-8087fff68285 (440dfdd8-800d-4d6e-a717-8087fff68285): created successfully
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70536cfa-fbb0-4bf2-8b2c-482022c9b456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (2e66205c-4d8a-4ad7-a584-9e0aaba3de74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4bc72539-de43-4472-afbf-f943a55b0fdd tempest-CreateVolumesFromImageTest-705853870 None] Created volume successfully.
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (755ef704-8af5-42f8-9a9a-90f7372375b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9332ea3-82fb-41dd-8dfd-fceaf1501bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9332ea3-82fb-41dd-8dfd-fceaf1501bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728792811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262b7be5-4657-4f95-9b48-3fff4feb3348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:46Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d672c36a-8d59-44a5-b56d-953604c3dcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d672c36a-8d59-44a5-b56d-953604c3dcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ab4d1b-b3fc-47e2-9d3b-d51e834364ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ab4d1b-b3fc-47e2-9d3b-d51e834364ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262b7be5-4657-4f95-9b48-3fff4feb3348', 'volume_name': 'volume-262b7be5-4657-4f95-9b48-3fff4feb3348', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e06f618-87df-4db8-bc3c-841e8ce0cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e06f618-87df-4db8-bc3c-841e8ce0cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919efe07-0a37-43ff-a871-911a564c68a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Volume 262b7be5-4657-4f95-9b48-3fff4feb3348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262b7be5-4657-4f95-9b48-3fff4feb3348', 'volume_size': 1}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:46 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff 1073741824" returned: 0 in 0.887s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (2c785ea4-2028-4112-bebe-99ddd5ff115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875cb500-b235-4e7c-ae0c-63b35d469952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875cb500-b235-4e7c-ae0c-63b35d469952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818655085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5abb3a-ce7c-48ad-b519-c1786c01615d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:46Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c820d1d2-a574-48a3-92e2-30c91a66da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c820d1d2-a574-48a3-92e2-30c91a66da3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c83c51-d42e-4a7e-a259-fd8bb60ad103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c83c51-d42e-4a7e-a259-fd8bb60ad103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5abb3a-ce7c-48ad-b519-c1786c01615d', 'volume_name': 'volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6598cc-74bd-470d-b6e1-7e873b34d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6598cc-74bd-470d-b6e1-7e873b34d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d208bc-5952-4dce-aa86-1bf80047add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Volume cb5abb3a-ce7c-48ad-b519-c1786c01615d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d', 'volume_size': 1}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:46 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff
Sep 09 13:25:46 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:46 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" returned: 0 in 0.258s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096418092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dcbe3b-d165-4e33-815e-d8924d446735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:45Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Creating volume 62dcbe3b-d165-4e33-815e-d8924d446735 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:46 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29196943-9767-4ed1-ade5-b243d247c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c1c43-62f3-4f8a-afa6-f102c8f3d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:46 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 1073741824
Sep 09 13:25:46 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Volume volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff (ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff): created successfully
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c1c43-62f3-4f8a-afa6-f102c8f3d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (bc45ef42-80ca-4849-954a-903563fbd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5e662d78-9bcd-43c4-9be0-308a6e89630c tempest-CreateVolumesFromImageTest-705853870 None] Created volume successfully.
Sep 09 13:25:47 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 1073741824" returned: 0 in 0.516s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:47 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735
Sep 09 13:25:47 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:47 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735" returned: 0 in 0.248s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728792811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262b7be5-4657-4f95-9b48-3fff4feb3348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:46Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Creating volume 262b7be5-4657-4f95-9b48-3fff4feb3348 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:47 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:47 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 1073741824
Sep 09 13:25:47 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5f0dd6-cde7-4df0-81a9-a0637a0a5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62dcbe3b-d165-4e33-815e-d8924d446735', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a52b6fd-e8f7-4b26-9b42-fc8045e88d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:47 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Volume volume-62dcbe3b-d165-4e33-815e-d8924d446735 (62dcbe3b-d165-4e33-815e-d8924d446735): created successfully
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a52b6fd-e8f7-4b26-9b42-fc8045e88d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:47 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (99ec97f8-faf3-41a1-acae-5ae498377d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7e346f4b-6155-4bdf-b7b2-0105754d0232 tempest-CreateVolumesFromImageTest-705853870 None] Created volume successfully.
Sep 09 13:25:48 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 1073741824" returned: 0 in 0.438s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:48 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348
Sep 09 13:25:48 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:48 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348" returned: 0 in 0.275s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818655085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5abb3a-ce7c-48ad-b519-c1786c01615d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab708255dc69447698f0fa3f9b2822b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:46Z,use_quota=True,user_id='a4f3ad796d624b2eab1528b23d68025b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Creating volume cb5abb3a-ce7c-48ad-b519-c1786c01615d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:48 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919efe07-0a37-43ff-a871-911a564c68a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262b7be5-4657-4f95-9b48-3fff4feb3348', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:48 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d 1073741824
Sep 09 13:25:48 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8545fbe-12e8-4e2c-bb56-b3f7d7563f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Volume volume-262b7be5-4657-4f95-9b48-3fff4feb3348 (262b7be5-4657-4f95-9b48-3fff4feb3348): created successfully
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8545fbe-12e8-4e2c-bb56-b3f7d7563f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (755ef704-8af5-42f8-9a9a-90f7372375b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-665e9a55-5010-4b7f-98b8-fa30330aeda7 tempest-CreateVolumesFromImageTest-705853870 None] Created volume successfully.
Sep 09 13:25:48 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d 1073741824" returned: 0 in 0.530s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:49 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d
Sep 09 13:25:49 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:49 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d" returned: 0 in 0.255s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d208bc-5952-4dce-aa86-1bf80047add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5aa211-6bd8-4ba3-bebc-f388ae37b7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Volume volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d (cb5abb3a-ce7c-48ad-b519-c1786c01615d): created successfully
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5aa211-6bd8-4ba3-bebc-f388ae37b7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Flow 'volume_create_manager' (2c785ea4-2028-4112-bebe-99ddd5ff115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6e488c61-826a-4ea3-8d13-719a7e922a07 tempest-CreateVolumesFromImageTest-705853870 None] Created volume successfully.
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-cb5abb3a-ce7c-48ad-b519-c1786c01615d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-cb5abb3a-ce7c-48ad-b519-c1786c01615d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-quobyte-cb5abb3a-ce7c-48ad-b519-c1786c01615d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-cb5abb3a-ce7c-48ad-b519-c1786c01615d" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a36537-1f0f-42f9-8913-0d9d94e9b614]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:50 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d
Sep 09 13:25:50 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:50 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d" returned: 0 in 0.389s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:50 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d
Sep 09 13:25:50 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:50 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-cb5abb3a-ce7c-48ad-b519-c1786c01615d" returned: 0 in 0.245s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-cb5abb3a-ce7c-48ad-b519-c1786c01615d" released by "delete_volume" :: held 0.679s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Created reservations ['cffd17af-140e-4461-afcb-b084a748fa27', 'f1f8d05e-4694-4343-a595-298baebcd1ef', 'c481b1ed-6b2a-44bd-bea9-9a1b583b41df', '56913913-5baf-4eca-8bd3-bfd2edb4d835'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:50 devstack sudo[103339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:50 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:50 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.275s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Deleted volume successfully.
Sep 09 13:25:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-262b7be5-4657-4f95-9b48-3fff4feb3348-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b6e9c0d9-4f17-482a-8577-92cda694cc88 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-cb5abb3a-ce7c-48ad-b519-c1786c01615d-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-262b7be5-4657-4f95-9b48-3fff4feb3348-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-quobyte-262b7be5-4657-4f95-9b48-3fff4feb3348" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-262b7be5-4657-4f95-9b48-3fff4feb3348" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a77d2cd-2881-4db4-bdbf-f38e972ce4e8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:51 devstack sudo[103342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348
Sep 09 13:25:51 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:51 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348" returned: 0 in 0.378s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:51 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348
Sep 09 13:25:51 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:51 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-262b7be5-4657-4f95-9b48-3fff4feb3348" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-262b7be5-4657-4f95-9b48-3fff4feb3348" released by "delete_volume" :: held 0.690s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Created reservations ['b9d4ae4c-5b5a-43ad-9614-f14596cb3751', '39f134ac-e19b-4b95-9e07-6d2f7a828a53', '49d39380-0f0c-4df5-b076-1a5bd5c8db41', '8f1c1c0b-7a6e-41c0-adc8-fdc23d1b4553'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:51 devstack sudo[103350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:51 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:52 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.259s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Deleted volume successfully.
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-62dcbe3b-d165-4e33-815e-d8924d446735-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2305e654-1cc5-42a4-9a86-55725e6d4f7e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-262b7be5-4657-4f95-9b48-3fff4feb3348-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-62dcbe3b-d165-4e33-815e-d8924d446735-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-quobyte-62dcbe3b-d165-4e33-815e-d8924d446735" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-62dcbe3b-d165-4e33-815e-d8924d446735" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53657e-955c-4775-bef7-a2bafb0b8799]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:52 devstack sudo[103353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735
Sep 09 13:25:52 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:52 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735" returned: 0 in 0.397s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:52 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735
Sep 09 13:25:52 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:52 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-62dcbe3b-d165-4e33-815e-d8924d446735" returned: 0 in 0.265s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-62dcbe3b-d165-4e33-815e-d8924d446735" released by "delete_volume" :: held 0.711s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Created reservations ['9f87dcd3-200b-4247-bec2-a9b47190d269', '52892a97-4646-4f7e-9247-2ef3760767d1', '15effb31-7c14-4932-a9c1-1271d20416d3', 'd203b1d6-9c31-47b0-adcb-f44a3634185e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:53 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:53 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:53 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.320s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Deleted volume successfully.
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-quobyte-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34d5aba7-1f5b-47dc-b65b-442f5779047e tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-62dcbe3b-d165-4e33-815e-d8924d446735-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3950328-d5ad-4d10-85f1-2e601f1efef9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:53 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff
Sep 09 13:25:53 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:53 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" returned: 0 in 0.417s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:53 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff
Sep 09 13:25:53 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:54 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" returned: 0 in 0.292s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff" released by "delete_volume" :: held 0.762s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Created reservations ['cdb60ea5-2434-49dc-a21d-13d38d44f045', '3025ce2f-a37a-4f76-a6a2-52a3d8ef4195', '5fc9bdc9-0c08-4a9d-8554-e2584730edc8', '1adcf830-1103-4de9-bb82-3364bdfe34ab'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:54 devstack sudo[103373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:54 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-440dfdd8-800d-4d6e-a717-8087fff68285-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-440dfdd8-800d-4d6e-a717-8087fff68285-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "cinder-quobyte-440dfdd8-800d-4d6e-a717-8087fff68285" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-440dfdd8-800d-4d6e-a717-8087fff68285" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b9d6c-efac-4f81-8914-dfcc4d58a157]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:54 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.369s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Deleted volume successfully.
Sep 09 13:25:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5ab00032-c4d4-45f2-bde2-a105ad31ea80 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-ac2f28de-cbad-4cf1-81ef-7fb6b6fc53ff-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:54 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285
Sep 09 13:25:54 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:55 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285" returned: 0 in 0.457s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:55 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285
Sep 09 13:25:55 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:55 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-440dfdd8-800d-4d6e-a717-8087fff68285" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-quobyte-440dfdd8-800d-4d6e-a717-8087fff68285" released by "delete_volume" :: held 0.768s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Created reservations ['abd82753-549a-4fc5-8d0a-98317af0874b', '6bb6e92a-c0e0-4a66-a44c-1265d2f5e99e', '578bdb7b-707e-4f88-a364-73939152f5f1', '0ed9ce92-c03a-4ebd-bfb9-5949b177159f'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:55 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:25:55 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:55 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.265s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:25:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Deleted volume successfully.
Sep 09 13:25:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-08999930-8bc7-48d8-a599-be13f1a18572 tempest-CreateVolumesFromImageTest-705853870 None] Lock "cinder-440dfdd8-800d-4d6e-a717-8087fff68285-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Flow 'volume_create_manager' (9f1a8b96-e5ac-4212-8626-6a3f9582ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c3e1ab-3d95-495b-91c7-6a3289743887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c3e1ab-3d95-495b-91c7-6a3289743887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2082039066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb5a1fa-8368-4b7a-9934-e64ed291ad1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c863ea1d6e64c0f91b748e9fe0a4a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:57Z,use_quota=True,user_id='a471869e513f4b3f86b28a63102897de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a55d668-9b09-4f02-b3d2-7449db0a95f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a55d668-9b09-4f02-b3d2-7449db0a95f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7d4a0-41af-446d-8ca8-79582083dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7d4a0-41af-446d-8ca8-79582083dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb5a1fa-8368-4b7a-9934-e64ed291ad1d', 'volume_name': 'volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6ade8e-40f3-473f-9fa6-09dd0c8994d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6ade8e-40f3-473f-9fa6-09dd0c8994d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133cd66f-0ad2-4c1b-a658-c8d9088776b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Volume 4bb5a1fa-8368-4b7a-9934-e64ed291ad1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d', 'volume_size': 1}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2082039066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb5a1fa-8368-4b7a-9934-e64ed291ad1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c863ea1d6e64c0f91b748e9fe0a4a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:57Z,use_quota=True,user_id='a471869e513f4b3f86b28a63102897de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Creating volume 4bb5a1fa-8368-4b7a-9934-e64ed291ad1d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:56 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:56 devstack sudo[103387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d 1073741824
Sep 09 13:25:56 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:57 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d 1073741824" returned: 0 in 0.466s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:57 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d
Sep 09 13:25:57 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:57 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133cd66f-0ad2-4c1b-a658-c8d9088776b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00858b4-14b0-4434-b65e-d0730a6be823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Volume volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d (4bb5a1fa-8368-4b7a-9934-e64ed291ad1d): created successfully
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00858b4-14b0-4434-b65e-d0730a6be823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Flow 'volume_create_manager' (9f1a8b96-e5ac-4212-8626-6a3f9582ff13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6955433b-3e18-4b9e-87d6-08e4a8a742a7 tempest-VolumesTransfersTest-648713262 None] Created volume successfully.
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Flow 'volume_create_manager' (df2887ef-5ae8-47d5-afd7-d77b3815eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375ee478-3793-4e1b-9fd1-b6dc74d695dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375ee478-3793-4e1b-9fd1-b6dc74d695dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866705769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da87c4-8e11-48d9-b235-7722962d47c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a35c6ef390d45c4a51e56c6e86b4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:59Z,use_quota=True,user_id='236dcc83253047e993c91e2c58ee5e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49d44dd-5183-4fe2-a7d9-c49254437408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49d44dd-5183-4fe2-a7d9-c49254437408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50301940-fcff-4dce-a167-a295951f01fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50301940-fcff-4dce-a167-a295951f01fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1da87c4-8e11-48d9-b235-7722962d47c4', 'volume_name': 'volume-c1da87c4-8e11-48d9-b235-7722962d47c4', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ff5331-dde4-4298-a218-d51e56aa2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ff5331-dde4-4298-a218-d51e56aa2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc971cf-96f1-426b-a0e9-5e4e896972f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:58 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Volume c1da87c4-8e11-48d9-b235-7722962d47c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1da87c4-8e11-48d9-b235-7722962d47c4', 'volume_size': 1}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866705769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da87c4-8e11-48d9-b235-7722962d47c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a35c6ef390d45c4a51e56c6e86b4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:25:59Z,use_quota=True,user_id='236dcc83253047e993c91e2c58ee5e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Creating volume c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:25:58 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:25:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:58 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 1073741824
Sep 09 13:25:58 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:59 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 1073741824" returned: 0 in 0.436s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:25:59 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:25:59 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:25:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1dacf1a8-661a-4744-b1e9-191c807f4387 tempest-VolumesTransfersTest-457179889 None] Transfer volume completed successfully.
Sep 09 13:25:59 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc971cf-96f1-426b-a0e9-5e4e896972f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1da87c4-8e11-48d9-b235-7722962d47c4', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591b1eb6-3d37-4264-88c5-de64fcb86113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:25:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Volume volume-c1da87c4-8e11-48d9-b235-7722962d47c4 (c1da87c4-8e11-48d9-b235-7722962d47c4): created successfully
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591b1eb6-3d37-4264-88c5-de64fcb86113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Flow 'volume_create_manager' (df2887ef-5ae8-47d5-afd7-d77b3815eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:25:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6b373948-c483-42d4-bb97-1edc86d1833f tempest-VolumeDependencyTests-1992046401 None] Created volume successfully.
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:25:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Creating offline snapshot 1cbf1402-786e-4ba2-a259-7086c8ac856c of volume c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[64042eec-6f63-4973-98dc-8321fe9147bb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Acquiring lock "cinder-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:00 devstack sudo[103408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:26:00 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "cinder-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Acquiring lock "cinder-quobyte-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "cinder-quobyte-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8622a5-1e8e-448b-9174-0744d5f92492]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:00 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d
Sep 09 13:26:00 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:00 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:00 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c 1G
Sep 09 13:26:00 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:00 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" returned: 0 in 0.357s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:00 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d
Sep 09 13:26:00 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:00 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c 1G" returned: 0 in 0.376s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1da87c4-8e11-48d9-b235-7722962d47c4 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:00 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1da87c4-8e11-48d9-b235-7722962d47c4 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:00 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:00 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" returned: 0 in 0.255s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "cinder-quobyte-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d" released by "delete_volume" :: held 0.651s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Created reservations ['08f7b602-3e6a-42ad-b8f4-e8b155cf5818', 'ab1f714e-cad0-4e63-a125-d1242856ecac', 'ca429c9e-74c3-4449-a254-1f7a73998986', 'fb060c35-2f20-49f0-afcf-b7cf97dfd32b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:01 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:01 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:01 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1da87c4-8e11-48d9-b235-7722962d47c4 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.309s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:01 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c is being set with open permissions: ugo+rw
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:01 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:01 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:01 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Deleted volume successfully.
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-948078fa-0fcc-4346-9b50-5df1da8f2c68 tempest-VolumesTransfersTest-408791585 None] Lock "cinder-4bb5a1fa-8368-4b7a-9934-e64ed291ad1d-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:01 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:01 devstack sudo[103437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info
Sep 09 13:26:01 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:01 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:01 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info is being set with open permissions: ugo+rw
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:01 devstack sudo[103440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info
Sep 09 13:26:01 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Flow 'volume_create_manager' (5f490707-e471-4afd-8b5d-a1656b6297ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692d3aa2-0359-4074-b56f-2b6845bbd14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692d3aa2-0359-4074-b56f-2b6845bbd14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-719228126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eba394f-0f7e-43e5-8ef7-c40b2659fd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c863ea1d6e64c0f91b748e9fe0a4a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:02Z,use_quota=True,user_id='a471869e513f4b3f86b28a63102897de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4caf8b7-be39-4fd6-a885-32b788c5cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4caf8b7-be39-4fd6-a885-32b788c5cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f75af7-fd99-46ef-ae86-ce6f5a330a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f75af7-fd99-46ef-ae86-ce6f5a330a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eba394f-0f7e-43e5-8ef7-c40b2659fd38', 'volume_name': 'volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c447c413-f598-4a2e-975e-4fed5457019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c447c413-f598-4a2e-975e-4fed5457019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b93cfd-26e4-454f-80af-cae2e995a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:01 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Volume 6eba394f-0f7e-43e5-8ef7-c40b2659fd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38', 'volume_size': 1}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:01 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.info" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-719228126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eba394f-0f7e-43e5-8ef7-c40b2659fd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c863ea1d6e64c0f91b748e9fe0a4a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:02Z,use_quota=True,user_id='a471869e513f4b3f86b28a63102897de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Creating volume 6eba394f-0f7e-43e5-8ef7-c40b2659fd38 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:01 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:01 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 1073741824
Sep 09 13:26:01 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a2dc0dc4-305d-4ee3-9f59-faa747f04200 tempest-VolumeDependencyTests-1992046401 None] Create snapshot completed successfully
Sep 09 13:26:02 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 1073741824" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:02 devstack sudo[103449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38
Sep 09 13:26:02 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:02 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" returned: 0 in 0.244s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b93cfd-26e4-454f-80af-cae2e995a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41663db9-7a5a-4d63-b41f-69e5922b661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:02 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Volume volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 (6eba394f-0f7e-43e5-8ef7-c40b2659fd38): created successfully
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41663db9-7a5a-4d63-b41f-69e5922b661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:02 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Flow 'volume_create_manager' (5f490707-e471-4afd-8b5d-a1656b6297ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1359fb49-3433-4c39-a6ee-302d9b11b959 tempest-VolumesTransfersTest-648713262 None] Created volume successfully.
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Acquiring lock "cinder-6eba394f-0f7e-43e5-8ef7-c40b2659fd38-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "cinder-6eba394f-0f7e-43e5-8ef7-c40b2659fd38-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Acquiring lock "cinder-quobyte-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "cinder-quobyte-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee992562-fe80-4bd3-841a-750c25625918]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:03 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38
Sep 09 13:26:03 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:03 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" returned: 0 in 0.385s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:03 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38
Sep 09 13:26:03 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Flow 'volume_create_manager' (47eab509-67b8-4172-bc89-e4266a8c2427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40ec55a-4fd5-450e-a310-4d10936ca124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40ec55a-4fd5-450e-a310-4d10936ca124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-297815282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f20aa7-f993-4458-a278-d77fd8281125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a35c6ef390d45c4a51e56c6e86b4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1cbf1402-786e-4ba2-a259-7086c8ac856c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:04Z,use_quota=True,user_id='236dcc83253047e993c91e2c58ee5e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2580428f-4969-491b-81f4-0b8b5ce17988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2580428f-4969-491b-81f4-0b8b5ce17988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da103b4c-ce66-4e34-8cec-94c01e2d38f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da103b4c-ce66-4e34-8cec-94c01e2d38f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23f20aa7-f993-4458-a278-d77fd8281125', 'volume_name': 'volume-23f20aa7-f993-4458-a278-d77fd8281125', 'volume_size': 1, 'snapshot_id': '1cbf1402-786e-4ba2-a259-7086c8ac856c'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92c16fe-b7e0-4de5-8c9b-dc08c0ef09fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92c16fe-b7e0-4de5-8c9b-dc08c0ef09fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aba41e9-af93-43f5-9af9-5d1939c43aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Volume 23f20aa7-f993-4458-a278-d77fd8281125: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23f20aa7-f993-4458-a278-d77fd8281125', 'volume_size': 1, 'snapshot_id': '1cbf1402-786e-4ba2-a259-7086c8ac856c'}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c-23f20aa7-f993-4458-a278-d77fd8281125" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c-23f20aa7-f993-4458-a278-d77fd8281125" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Creating volume 23f20aa7-f993-4458-a278-d77fd8281125 from snapshot 1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] snapshot: 1cbf1402-786e-4ba2-a259-7086c8ac856c, volume: 23f20aa7-f993-4458-a278-d77fd8281125,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:26:03 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" returned: 0 in 0.277s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[251a49f4-fd36-4c4c-9856-a6af89826f05]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "cinder-quobyte-6eba394f-0f7e-43e5-8ef7-c40b2659fd38" released by "delete_volume" :: held 0.717s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Created reservations ['c1ae5d77-3934-4fc6-9a83-58d97707396a', '135aab26-d3ef-486c-9750-4eeee561d267', '9e6ccf52-aba9-4ec8-8e3e-1292ef665ed2', '3d38db48-49d8-494b-8bc8-9de0fb07f275'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:03 devstack sudo[103460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:03 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:04 devstack sudo[103462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:04 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:04 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.406s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:04 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1da87c4-8e11-48d9-b235-7722962d47c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Deleted volume successfully.
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada6b546-378f-4e67-a098-dc623b8626ad]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bcb178e5-574f-4014-b29a-ee127656987d tempest-VolumesTransfersTest-408791585 None] Lock "cinder-6eba394f-0f7e-43e5-8ef7-c40b2659fd38-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:04 devstack sudo[103468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:26:04 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:04 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.390s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:26:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:04 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125
Sep 09 13:26:04 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:09 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125" returned: 0 in 4.911s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:26:09 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Converted 1024.00 MB image at 208.45 MB/s
Sep 09 13:26:09 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 is being set with open permissions: ugo+rw
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:09 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125
Sep 09 13:26:09 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:09 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125" returned: 0 in 0.289s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" released by "_copy_volume_from_snapshot" :: held 6.082s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c-23f20aa7-f993-4458-a278-d77fd8281125" released by "_create_volume_from_snapshot" :: held 6.161s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.180s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aba41e9-af93-43f5-9af9-5d1939c43aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f20aa7-f993-4458-a278-d77fd8281125', 'volume_size': 1, 'snapshot_id': '1cbf1402-786e-4ba2-a259-7086c8ac856c'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36453b27-044c-4ca8-a45c-88fd34f7f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Volume volume-23f20aa7-f993-4458-a278-d77fd8281125 (23f20aa7-f993-4458-a278-d77fd8281125): created successfully
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36453b27-044c-4ca8-a45c-88fd34f7f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Flow 'volume_create_manager' (47eab509-67b8-4172-bc89-e4266a8c2427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1c293734-5a93-4f24-9906-4da44c67988d tempest-VolumeDependencyTests-1992046401 None] Created volume successfully.
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-1cbf1402-786e-4ba2-a259-7086c8ac856c-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-1cbf1402-786e-4ba2-a259-7086c8ac856c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Deleting offline snapshot 1cbf1402-786e-4ba2-a259-7086c8ac856c of volume c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] snapshot_file for this snap is: volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafcbd0f-8898-4a9b-be6c-61c4474eb393]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:10 devstack sudo[103501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:10 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:11 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.650s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1da87c4-8e11-48d9-b235-7722962d47c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[363eecd4-4ca6-4207-a6e7-f17ae50e78fc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:11 devstack sudo[103525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:26:11 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:11 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.672s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:11 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:11 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:12 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.465s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-39945d0e-39eb-4d99-83de-68ae5a4a14ee tempest-TestShelveInstance-1137941889 None] Terminate volume connection completed successfully.
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-39945d0e-39eb-4d99-83de-68ae5a4a14ee tempest-TestShelveInstance-1137941889 None] Deleting attachment 5787426e-cceb-4d51-97fd-687fdead0ac5. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:26:12 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c
Sep 09 13:26:12 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Acquiring lock "cinder-24f107da-8ebd-4328-bc90-1946ba0690a5-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "cinder-24f107da-8ebd-4328-bc90-1946ba0690a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Acquiring lock "cinder-quobyte-24f107da-8ebd-4328-bc90-1946ba0690a5" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "cinder-quobyte-24f107da-8ebd-4328-bc90-1946ba0690a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:12 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4.1cbf1402-786e-4ba2-a259-7086c8ac856c" returned: 0 in 0.306s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a4a3c-1436-453a-b7b3-edc26f8897e6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-1cbf1402-786e-4ba2-a259-7086c8ac856c" released by "_delete_snapshot" :: held 2.252s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" released by "delete_snapshot" :: held 2.288s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Created reservations ['bf28c521-484d-4999-af8c-1078610c4880', 'a6b0b1b4-a5c7-4d2b-adba-dd0063011607', '2e7f96cd-762d-4377-9f4b-9efb69610c07', '0cfbf0e8-8cb2-4c0d-9ba4-2b9c7cbe420e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:12 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5
Sep 09 13:26:12 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Delete snapshot completed successfully.
Sep 09 13:26:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-223ede37-3c64-499b-acb4-d942bd2c5d21 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-1cbf1402-786e-4ba2-a259-7086c8ac856c-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:13 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5" returned: 0 in 0.457s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:13 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5
Sep 09 13:26:13 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:13 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-24f107da-8ebd-4328-bc90-1946ba0690a5" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "cinder-quobyte-24f107da-8ebd-4328-bc90-1946ba0690a5" released by "delete_volume" :: held 0.834s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.quota [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Created reservations ['d8ce32a5-d7c0-4cac-a0a2-704518a80336', '7bfbc31e-edc7-4d5c-80db-a888496636e2', '6d545637-677a-4702-9b7e-8d8cdeef7a3b', '6b00e132-1ab1-440c-9354-7663ee92d7bd'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:13 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:13 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-c1da87c4-8e11-48d9-b235-7722962d47c4-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-c1da87c4-8e11-48d9-b235-7722962d47c4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5125958e-5c5c-4e5b-a44f-866a2899c41e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:14 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.392s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.manager [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Deleted volume successfully.
Sep 09 13:26:14 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:26:14 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [req-ecd82a8f-dee7-4d7a-afbc-e4b575d7ebe2 req-5fa4630f-6092-4ad3-83ff-e1bebf8b1a90 tempest-TestShelveInstance-1137941889 None] Lock "cinder-24f107da-8ebd-4328-bc90-1946ba0690a5-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:14 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.432s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:14 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4
Sep 09 13:26:14 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:14 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1da87c4-8e11-48d9-b235-7722962d47c4" returned: 0 in 0.301s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-c1da87c4-8e11-48d9-b235-7722962d47c4" released by "delete_volume" :: held 0.825s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Created reservations ['3d8a20e3-e0f8-4b60-ab1c-16c80fc6ed6c', '45a952d8-efb5-4256-8a8c-302e3b89704d', '585f6bfc-3638-4d4f-bbee-02bb19c5043f', '2217b5a8-962f-4a1a-81f8-83d38208dc9d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:14 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:14 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-23f20aa7-f993-4458-a278-d77fd8281125-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-23f20aa7-f993-4458-a278-d77fd8281125-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58ee06d-7839-4dff-84d8-e84f7503709a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:15 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125
Sep 09 13:26:15 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:15 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.427s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Deleted volume successfully.
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-73db3f11-9d3d-45bb-a81e-bf85f00cf0d6 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-c1da87c4-8e11-48d9-b235-7722962d47c4-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:15 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:15 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125
Sep 09 13:26:15 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:15 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-23f20aa7-f993-4458-a278-d77fd8281125" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-quobyte-23f20aa7-f993-4458-a278-d77fd8281125" released by "delete_volume" :: held 0.786s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Created reservations ['25537645-1616-4525-a4bc-94c71f4d94d5', '31415ca9-a64e-44dd-a8cd-3f7b170ab54e', 'd3bad775-a45d-4b63-afdf-b5a9b696923e', '105e591d-c401-471e-a187-a64edb056b5b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:16 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:16 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:16 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:16 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Deleted volume successfully.
Sep 09 13:26:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1a16929-9e26-4e67-9bf3-aa6a2fab9be0 tempest-VolumeDependencyTests-1992046401 None] Lock "cinder-23f20aa7-f993-4458-a278-d77fd8281125-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:23 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Flow 'volume_create_manager' (9845c9fe-692a-4092-bb2d-9694bba5b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dd4fe0-c125-4966-aa45-c979e667571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dd4fe0-c125-4966-aa45-c979e667571c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28809d55-7b5d-43c3-9ac3-ac0b2a4aacee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017c6f4647174a41894fa05474802eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:24Z,use_quota=True,user_id='0545791f0d6947de9274b1365ffe1721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed177b59-3111-4d4e-9845-a27e71b1438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed177b59-3111-4d4e-9845-a27e71b1438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c60b9-7d51-4c68-a99e-ca6ee0d4788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802c60b9-7d51-4c68-a99e-ca6ee0d4788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28809d55-7b5d-43c3-9ac3-ac0b2a4aacee', 'volume_name': 'volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee', 'volume_size': 1, 'image_id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0be4f1b3f8fe6508d6dc55486702c092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '017c6f4647174a41894fa05474802eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124089d210904390af227d5086793f4622fe9c3af98d6aa6b765a4ca24626ccd5859734e722156d66a5499c8555973908daaad1ab99b426fcfdfbac1032f3b3b', 'id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'created_at': datetime.datetime(2026, 9, 9, 11, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46880069-af75-43b6-8b65-6570cac1f4d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545f18920>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed0988-5e9a-4de6-bfe8-608091758af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed0988-5e9a-4de6-bfe8-608091758af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5607f3af-7c84-4e80-a7fb-2cd359404b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:24 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee', 'volume_size': 1, 'image_id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0be4f1b3f8fe6508d6dc55486702c092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '017c6f4647174a41894fa05474802eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124089d210904390af227d5086793f4622fe9c3af98d6aa6b765a4ca24626ccd5859734e722156d66a5499c8555973908daaad1ab99b426fcfdfbac1032f3b3b', 'id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'created_at': datetime.datetime(2026, 9, 9, 11, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46880069-af75-43b6-8b65-6570cac1f4d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545f18920>}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Trying to clone 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee from image 46880069-af75-43b6-8b65-6570cac1f4d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:26:24 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[91187409-e7a3-4416-b224-a4371c1861d8]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:24 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:24 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:24 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:25 devstack sudo[103621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:25 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:26:25 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Temporary image 46880069-af75-43b6-8b65-6570cac1f4d7 is fetched for user 0545791f0d6947de9274b1365ffe1721. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:26:25 devstack sudo[103626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:25 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f0886-3ff7-477a-8b5f-a5954f5322b7]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:25 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:25 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:25 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.412s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:26:25 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:26 devstack sudo[103633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:26 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:26 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28809d55-7b5d-43c3-9ac3-ac0b2a4aacee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017c6f4647174a41894fa05474802eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:24Z,use_quota=True,user_id='0545791f0d6947de9274b1365ffe1721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Creating volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:26 devstack sudo[103638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1073741824
Sep 09 13:26:26 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:26 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1073741824" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:27 devstack sudo[103644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee
Sep 09 13:26:27 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:27 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" returned: 0 in 0.323s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Attempting download of 46880069-af75-43b6-8b65-6570cac1f4d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}])) to volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba341393-3b48-4b3c-b164-0e635f0b27c4]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:27 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky
Sep 09 13:26:27 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:27 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:27 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky
Sep 09 13:26:27 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:28 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky" returned: 1 in 0.433s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46880069-af75-43b6-8b65-6570cac1f4d7_rh3_soky' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab18b9-935f-428b-b27f-3db0a441c3aa]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Flow 'volume_create_manager' (db3906dc-210d-438b-ada8-a4e2aa6c390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cd3f1b-6df6-4f29-8df6-8edc443e11ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:28 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:28 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cd3f1b-6df6-4f29-8df6-8edc443e11ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564933664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2d9fe-b130-413f-8967-8409dd1bcaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89db711a441742ed969ab7da143e4173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:28Z,use_quota=True,user_id='167d754215e541bf8bc3999cae74ace5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b1b3e7-a70d-4e86-8e46-73f3b77c94da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b1b3e7-a70d-4e86-8e46-73f3b77c94da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7d15f4-2d3d-41c7-bdf7-dec4f7e19937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7d15f4-2d3d-41c7-bdf7-dec4f7e19937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e2d9fe-b130-413f-8967-8409dd1bcaea', 'volume_name': 'volume-97e2d9fe-b130-413f-8967-8409dd1bcaea', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddff1bd-987f-4fac-81bf-3e236a78a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddff1bd-987f-4fac-81bf-3e236a78a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd5cd49-e2cb-432d-8362-e34eff5314ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Volume 97e2d9fe-b130-413f-8967-8409dd1bcaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e2d9fe-b130-413f-8967-8409dd1bcaea', 'volume_size': 1}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564933664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2d9fe-b130-413f-8967-8409dd1bcaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89db711a441742ed969ab7da143e4173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:28Z,use_quota=True,user_id='167d754215e541bf8bc3999cae74ace5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Creating volume 97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:28 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:28 devstack sudo[103657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea 1073741824
Sep 09 13:26:28 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:28 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:28 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD
Sep 09 13:26:28 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:28 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea 1073741824" returned: 0 in 0.519s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:28 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] 46880069-af75-43b6-8b65-6570cac1f4d7 was raw, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:28 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee
Sep 09 13:26:28 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:29 devstack sudo[103672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:26:29 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (e7590d8a-a903-4c3f-8274-91554477934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48a9b87-b7c3-4e0e-87a6-58ba90702bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48a9b87-b7c3-4e0e-87a6-58ba90702bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-224593984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04b2222-fb91-4654-8b07-fc3c0d1bbbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:29Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee62a8c1-f462-4aad-b4a1-6eaa47de7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee62a8c1-f462-4aad-b4a1-6eaa47de7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18345a52-2ba7-4569-bf27-41deda45fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18345a52-2ba7-4569-bf27-41deda45fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04b2222-fb91-4654-8b07-fc3c0d1bbbfe', 'volume_name': 'volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97937ac7-2f52-4df2-be6c-5c25c2ef8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97937ac7-2f52-4df2-be6c-5c25c2ef8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067c1603-58b9-4283-bd7e-68e85320db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume e04b2222-fb91-4654-8b07-fc3c0d1bbbfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe', 'volume_size': 1}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:29 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-224593984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04b2222-fb91-4654-8b07-fc3c0d1bbbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:29Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume e04b2222-fb91-4654-8b07-fc3c0d1bbbfe {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd5cd49-e2cb-432d-8362-e34eff5314ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e2d9fe-b130-413f-8967-8409dd1bcaea', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d9e2a-d641-4fce-8ccf-cf56a85d3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack sudo[103679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe 1073741824
Sep 09 13:26:29 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Volume volume-97e2d9fe-b130-413f-8967-8409dd1bcaea (97e2d9fe-b130-413f-8967-8409dd1bcaea): created successfully
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d9e2a-d641-4fce-8ccf-cf56a85d3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Flow 'volume_create_manager' (db3906dc-210d-438b-ada8-a4e2aa6c390a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c141f314-8f94-4519-ad45-253c78c9426f tempest-VolumesActionsTest-488506953 None] Created volume successfully.
Sep 09 13:26:29 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" returned: 0 in 0.506s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46880069-af75-43b6-8b65-6570cac1f4d7_n1bepixydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:29 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1G
Sep 09 13:26:29 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:29 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe 1073741824" returned: 0 in 0.427s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:29 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe
Sep 09 13:26:29 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:29 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee 1G" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Downloaded image 46880069-af75-43b6-8b65-6570cac1f4d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}])) to volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Temporary image 46880069-af75-43b6-8b65-6570cac1f4d7 for user 0545791f0d6947de9274b1365ffe1721 is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Marking volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Copying metadata from image 46880069-af75-43b6-8b65-6570cac1f4d7 to 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Creating volume glance metadata for volume 28809d55-7b5d-43c3-9ac3-ac0b2a4aacee backed by image 46880069-af75-43b6-8b65-6570cac1f4d7 with: {'image_id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0be4f1b3f8fe6508d6dc55486702c092', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5607f3af-7c84-4e80-a7fb-2cd359404b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee', 'volume_size': 1, 'image_id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46880069-af75-43b6-8b65-6570cac1f4d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0be4f1b3f8fe6508d6dc55486702c092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '017c6f4647174a41894fa05474802eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '124089d210904390af227d5086793f4622fe9c3af98d6aa6b765a4ca24626ccd5859734e722156d66a5499c8555973908daaad1ab99b426fcfdfbac1032f3b3b', 'id': '46880069-af75-43b6-8b65-6570cac1f4d7', 'created_at': datetime.datetime(2026, 9, 9, 11, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46880069-af75-43b6-8b65-6570cac1f4d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545f18920>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4500ae27-973b-4956-a41a-d8a0e32381e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Volume volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee (28809d55-7b5d-43c3-9ac3-ac0b2a4aacee): created successfully
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4500ae27-973b-4956-a41a-d8a0e32381e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Flow 'volume_create_manager' (9845c9fe-692a-4092-bb2d-9694bba5b15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5a5ec753-ea64-4eaa-9911-a4389fd3509f tempest-VolumeImageDependencyTests-500179690 None] Created volume successfully.
Sep 09 13:26:29 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067c1603-58b9-4283-bd7e-68e85320db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d2bbdd-c7e4-4a85-86e9-abab1ac73144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:30 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe (e04b2222-fb91-4654-8b07-fc3c0d1bbbfe): created successfully
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d2bbdd-c7e4-4a85-86e9-abab1ac73144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (e7590d8a-a903-4c3f-8274-91554477934a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-110e2374-ed41-46c4-a89e-fa950f1482b2 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Acquiring lock "cinder-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "cinder-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Acquiring lock "cinder-quobyte-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "cinder-quobyte-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16f04a-b329-42db-9ea6-60de198b177a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:30 devstack sudo[103695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee
Sep 09 13:26:30 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:30 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" returned: 0 in 0.407s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:31 devstack sudo[103700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee
Sep 09 13:26:31 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:31 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "cinder-quobyte-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee" released by "delete_volume" :: held 0.804s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Created reservations ['db98244e-8a28-4a46-932c-d1d609a756b5', '108cecc0-31f3-4ae9-a958-a1af5860ed12', 'cf414fa8-cb39-43bd-b304-bd7c63694902', 'a09e719c-8f25-4744-bf7f-f3ca17e52cd8'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:31 devstack sudo[103706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:31 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (6d3f496f-506b-4bb9-ad75-124deb2ba460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b601c0a-7bfe-404d-b3c1-3954d0ae6ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b601c0a-7bfe-404d-b3c1-3954d0ae6ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1345387148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab0e06b-a33c-4cd5-a3df-226af4ee95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:32Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bab8f2-77e5-438a-8dea-39f8a270d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bab8f2-77e5-438a-8dea-39f8a270d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448e69cd-4fe5-4d29-b9b9-c1b35f36b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448e69cd-4fe5-4d29-b9b9-c1b35f36b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab0e06b-a33c-4cd5-a3df-226af4ee95c3', 'volume_name': 'volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6196a-78a8-4217-aef6-59083e357817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6196a-78a8-4217-aef6-59083e357817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8f61da-4fa0-4109-8a41-5220985d2bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:31 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume 1ab0e06b-a33c-4cd5-a3df-226af4ee95c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3', 'volume_size': 1}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1345387148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab0e06b-a33c-4cd5-a3df-226af4ee95c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:32Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume 1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:31 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:31 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 1073741824
Sep 09 13:26:31 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:31 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.372s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:31 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Deleted volume successfully.
Sep 09 13:26:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-bdd9ce9b-2c0f-4f24-8f75-ad9d33e41fd1 tempest-VolumeImageDependencyTests-500179690 None] Lock "cinder-28809d55-7b5d-43c3-9ac3-ac0b2a4aacee-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (bdff43f8-1e82-42f4-8e81-fc78a3fc3d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49bd3bd-2eb1-4557-851c-7125bcf9cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49bd3bd-2eb1-4557-851c-7125bcf9cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181746598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e380a1a-b7d0-4a1f-ae83-f85554d1be81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:32Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4652e-350b-470c-b478-dd60186ace27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4652e-350b-470c-b478-dd60186ace27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8991d281-6348-4c13-894b-8d1e2fe78022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8991d281-6348-4c13-894b-8d1e2fe78022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e380a1a-b7d0-4a1f-ae83-f85554d1be81', 'volume_name': 'volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50709e6e-60a5-4d36-abc8-20d5b2b77afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50709e6e-60a5-4d36-abc8-20d5b2b77afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c50a6-b215-4ae7-bc7f-62f77bc853cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume 2e380a1a-b7d0-4a1f-ae83-f85554d1be81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81', 'volume_size': 1}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:32 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 1073741824" returned: 0 in 0.874s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:32 devstack sudo[103720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3
Sep 09 13:26:32 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (b9fa9166-caec-45a1-922d-90390e0e794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36469f65-cade-4204-a846-4e0c246ec836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36469f65-cade-4204-a846-4e0c246ec836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257256865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5692ea-c9da-4e40-89f2-09a1d9e8a41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:33Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982d5e7b-baf8-40f6-a3bc-96fb921d56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982d5e7b-baf8-40f6-a3bc-96fb921d56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99abc3b-151c-483b-ae0a-486eef860050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99abc3b-151c-483b-ae0a-486eef860050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5692ea-c9da-4e40-89f2-09a1d9e8a41b', 'volume_name': 'volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4898755-3e4a-4644-a911-007be1a97c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4898755-3e4a-4644-a911-007be1a97c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8783d-a1bb-4fd4-ad50-8ac730477492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume 0c5692ea-c9da-4e40-89f2-09a1d9e8a41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b', 'volume_size': 1}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" returned: 0 in 0.332s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181746598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e380a1a-b7d0-4a1f-ae83-f85554d1be81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:32Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume 2e380a1a-b7d0-4a1f-ae83-f85554d1be81 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:33 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8f61da-4fa0-4109-8a41-5220985d2bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a6e67-4082-4fce-befa-fdfaecc3edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 1073741824
Sep 09 13:26:33 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 (1ab0e06b-a33c-4cd5-a3df-226af4ee95c3): created successfully
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a6e67-4082-4fce-befa-fdfaecc3edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (6d3f496f-506b-4bb9-ad75-124deb2ba460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cf3751ef-1399-47de-a7bf-d6c23b60f731 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (5f9d5665-8181-4e09-8f85-e99139e9862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3258f4-00f0-4ee2-b7cc-309087be9cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3258f4-00f0-4ee2-b7cc-309087be9cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647043057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471666c5-de86-4609-838e-5604e1616cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:33Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a286c-09ce-4e4d-bb2f-3207a084b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71a286c-09ce-4e4d-bb2f-3207a084b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d78acf-08f8-49bb-9d3b-1add3afab829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d78acf-08f8-49bb-9d3b-1add3afab829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471666c5-de86-4609-838e-5604e1616cc5', 'volume_name': 'volume-471666c5-de86-4609-838e-5604e1616cc5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b22219-27cc-4c53-9585-712fa0c053c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b22219-27cc-4c53-9585-712fa0c053c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1fdadf-4550-4f21-a140-aa762f44a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume 471666c5-de86-4609-838e-5604e1616cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471666c5-de86-4609-838e-5604e1616cc5', 'volume_size': 1}
Sep 09 13:26:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:34 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 1073741824" returned: 0 in 0.987s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:34 devstack sudo[103738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81
Sep 09 13:26:34 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (cf9451f7-9650-43f8-b5bc-48bc6d60096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5037aaf-1194-4165-a548-039c7849f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5037aaf-1194-4165-a548-039c7849f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337877613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c01b760-5c1c-4f96-acf8-37743d76d00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:34Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e293b4a9-b9db-4605-be76-a0167e986ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e293b4a9-b9db-4605-be76-a0167e986ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4e23e0-4057-46de-9666-dfac2a5d4e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4e23e0-4057-46de-9666-dfac2a5d4e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c01b760-5c1c-4f96-acf8-37743d76d00b', 'volume_name': 'volume-6c01b760-5c1c-4f96-acf8-37743d76d00b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ef7b8e-ad52-4280-bf0b-86854534b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ef7b8e-ad52-4280-bf0b-86854534b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9edd00-e0b2-4a30-8cc6-f905fe31bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume 6c01b760-5c1c-4f96-acf8-37743d76d00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c01b760-5c1c-4f96-acf8-37743d76d00b', 'volume_size': 1}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:34 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" returned: 0 in 0.473s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257256865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5692ea-c9da-4e40-89f2-09a1d9e8a41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:33Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume 0c5692ea-c9da-4e40-89f2-09a1d9e8a41b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:34 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:34 devstack sudo[103746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b 1073741824
Sep 09 13:26:34 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738c50a6-b215-4ae7-bc7f-62f77bc853cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1ec03c-3b70-45a7-9afe-79433924eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 (2e380a1a-b7d0-4a1f-ae83-f85554d1be81): created successfully
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1ec03c-3b70-45a7-9afe-79433924eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (bdff43f8-1e82-42f4-8e81-fc78a3fc3d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0c9069e9-5946-4092-9513-6779dea0ec3e tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:35 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b 1073741824" returned: 0 in 0.667s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:35 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b
Sep 09 13:26:35 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:35 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" returned: 0 in 0.298s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647043057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471666c5-de86-4609-838e-5604e1616cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:33Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume 471666c5-de86-4609-838e-5604e1616cc5 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:35 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:35 devstack sudo[103759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 1073741824
Sep 09 13:26:35 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8783d-a1bb-4fd4-ad50-8ac730477492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575c64f-9e7c-428a-933c-da9a5778aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:35 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b (0c5692ea-c9da-4e40-89f2-09a1d9e8a41b): created successfully
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575c64f-9e7c-428a-933c-da9a5778aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (b9fa9166-caec-45a1-922d-90390e0e794a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-44905f4d-92f2-437e-b2ac-30ac32198831 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:36 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 1073741824" returned: 0 in 0.541s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:36 devstack sudo[103766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5
Sep 09 13:26:36 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:36 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337877613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c01b760-5c1c-4f96-acf8-37743d76d00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e18b1ce2a84b4fab1d8335db11db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:34Z,use_quota=True,user_id='e60d24e219324357966e83ddedb3d343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Creating volume 6c01b760-5c1c-4f96-acf8-37743d76d00b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:36 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1fdadf-4550-4f21-a140-aa762f44a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471666c5-de86-4609-838e-5604e1616cc5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:36 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b 1073741824
Sep 09 13:26:36 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae2611a-d3bb-47b4-89cc-315e40381e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:36 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-471666c5-de86-4609-838e-5604e1616cc5 (471666c5-de86-4609-838e-5604e1616cc5): created successfully
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae2611a-d3bb-47b4-89cc-315e40381e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (5f9d5665-8181-4e09-8f85-e99139e9862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e019fc40-61b0-4bc5-af73-d3f54aa954c5 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:37 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b 1073741824" returned: 0 in 0.905s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:37 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b
Sep 09 13:26:37 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Flow 'volume_create_manager' (d628dce0-1b1d-48bf-a257-79b03009f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b860c08c-f86f-4c04-8756-dfaf38423b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b860c08c-f86f-4c04-8756-dfaf38423b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696785975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72198d07-9d47-4834-9a06-adf2d00531cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb902b91eaa4f99b2c71f79dc52fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:38Z,use_quota=True,user_id='3b2aec2f1490452199f80ff84b0cb0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aada69-6394-4721-8812-70d301a929c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aada69-6394-4721-8812-70d301a929c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e828422e-c07e-42e7-9d32-7b5e33aff080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e828422e-c07e-42e7-9d32-7b5e33aff080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72198d07-9d47-4834-9a06-adf2d00531cb', 'volume_name': 'volume-72198d07-9d47-4834-9a06-adf2d00531cb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5573a3-80d3-403f-ac85-f90754843149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5573a3-80d3-403f-ac85-f90754843149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ce5aad-d4e0-425f-92b8-e472e523e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Volume 72198d07-9d47-4834-9a06-adf2d00531cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72198d07-9d47-4834-9a06-adf2d00531cb', 'volume_size': 1}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b" returned: 0 in 0.584s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696785975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72198d07-9d47-4834-9a06-adf2d00531cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb902b91eaa4f99b2c71f79dc52fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:38Z,use_quota=True,user_id='3b2aec2f1490452199f80ff84b0cb0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Creating volume 72198d07-9d47-4834-9a06-adf2d00531cb {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9edd00-e0b2-4a30-8cc6-f905fe31bc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c01b760-5c1c-4f96-acf8-37743d76d00b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb 1073741824
Sep 09 13:26:38 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb99b5a8-2857-452f-bd9c-46429d13198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Volume volume-6c01b760-5c1c-4f96-acf8-37743d76d00b (6c01b760-5c1c-4f96-acf8-37743d76d00b): created successfully
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb99b5a8-2857-452f-bd9c-46429d13198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Flow 'volume_create_manager' (cf9451f7-9650-43f8-b5bc-48bc6d60096b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b4967edb-ad00-47fc-b5e2-1831ce6c9676 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created volume successfully.
Sep 09 13:26:38 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb 1073741824" returned: 0 in 0.521s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:38 devstack sudo[103854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb
Sep 09 13:26:38 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-6c01b760-5c1c-4f96-acf8-37743d76d00b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-6c01b760-5c1c-4f96-acf8-37743d76d00b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-6c01b760-5c1c-4f96-acf8-37743d76d00b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-6c01b760-5c1c-4f96-acf8-37743d76d00b" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[59106163-7fd1-438c-b20d-1697b263b9c5]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:39 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ce5aad-d4e0-425f-92b8-e472e523e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72198d07-9d47-4834-9a06-adf2d00531cb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd54678-8694-45b1-a32e-714a3b5705e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Volume volume-72198d07-9d47-4834-9a06-adf2d00531cb (72198d07-9d47-4834-9a06-adf2d00531cb): created successfully
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd54678-8694-45b1-a32e-714a3b5705e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Flow 'volume_create_manager' (d628dce0-1b1d-48bf-a257-79b03009f950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:39 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b
Sep 09 13:26:39 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4292b7dc-675c-4207-92d8-29e24017a55c tempest-ProjectReaderTests-306576214 None] Created volume successfully.
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fd683b0c-f52c-40ca-9b1f-b8a771a3eb7b tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" by "attach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fd683b0c-f52c-40ca-9b1f-b8a771a3eb7b tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" acquired by "attach_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:39 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b" returned: 0 in 0.445s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:39 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b
Sep 09 13:26:39 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fd683b0c-f52c-40ca-9b1f-b8a771a3eb7b tempest-VolumesActionsTest-488506953 None] Attaching volume 97e2d9fe-b130-413f-8967-8409dd1bcaea to instance 217d2260-14cd-4235-ad2b-cade819b3747 at mountpoint /dev/vdb on host None.
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fd683b0c-f52c-40ca-9b1f-b8a771a3eb7b tempest-VolumesActionsTest-488506953 None] Attach volume completed successfully.
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fd683b0c-f52c-40ca-9b1f-b8a771a3eb7b tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" released by "attach_volume" :: held 0.122s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:39 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b3c72044-94a0-4ab8-810c-3a2ec56338ec tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" by "detach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6c01b760-5c1c-4f96-acf8-37743d76d00b" returned: 0 in 0.268s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b3c72044-94a0-4ab8-810c-3a2ec56338ec tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b3c72044-94a0-4ab8-810c-3a2ec56338ec tempest-VolumesActionsTest-488506953 None] Detaching volume 97e2d9fe-b130-413f-8967-8409dd1bcaea from instance 217d2260-14cd-4235-ad2b-cade819b3747.
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-6c01b760-5c1c-4f96-acf8-37743d76d00b" released by "delete_volume" :: held 0.765s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b3c72044-94a0-4ab8-810c-3a2ec56338ec tempest-VolumesActionsTest-488506953 None] Detach volume completed successfully.
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['bbcbcb7f-fedc-4794-840e-046e6b0f8906', '1e2f37f5-7790-4efa-afca-d9cebd47d122', 'b9042967-9a09-4c6e-8d81-f6e92b6ce308', 'ffbc9920-8f32-47c0-be27-d712e31879fe'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b3c72044-94a0-4ab8-810c-3a2ec56338ec tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:40 devstack sudo[103867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:40 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-471666c5-de86-4609-838e-5604e1616cc5-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-471666c5-de86-4609-838e-5604e1616cc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-471666c5-de86-4609-838e-5604e1616cc5" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-471666c5-de86-4609-838e-5604e1616cc5" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26c893-1fa4-4c4d-8c7f-0e0888765289]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:40 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.580s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:40 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5
Sep 09 13:26:40 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ef139386-580e-43df-8065-be794850cb51 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-6c01b760-5c1c-4f96-acf8-37743d76d00b-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Acquiring lock "cinder-72198d07-9d47-4834-9a06-adf2d00531cb-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "cinder-72198d07-9d47-4834-9a06-adf2d00531cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Acquiring lock "cinder-quobyte-72198d07-9d47-4834-9a06-adf2d00531cb" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "cinder-quobyte-72198d07-9d47-4834-9a06-adf2d00531cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[477801de-848c-4821-860b-7f0a909001e1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:41 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb
Sep 09 13:26:41 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:41 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5" returned: 0 in 0.666s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:41 devstack sudo[103898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5
Sep 09 13:26:41 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:41 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-471666c5-de86-4609-838e-5604e1616cc5" returned: 0 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:41 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb" returned: 0 in 0.629s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-471666c5-de86-4609-838e-5604e1616cc5" released by "delete_volume" :: held 1.080s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=156,cinder:SELECT=118,cinder:DELETE=18,cinder:INSERT=44 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:26:41 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=128,cinder:UPDATE=169,cinder:INSERT=38,cinder:DELETE=13 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:26:41 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['457e6220-548f-4203-9d6a-7f77ec12267f', 'c6e3e475-81a2-45a5-8588-348dc9a14e78', 'e7627e65-b405-4965-8baa-b2080ec42722', '2b6d06f9-f520-47c1-a1ef-9adfe5017c75'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:41 devstack sudo[103909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:41 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:41 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-72198d07-9d47-4834-9a06-adf2d00531cb" returned: 0 in 0.339s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "cinder-quobyte-72198d07-9d47-4834-9a06-adf2d00531cb" released by "delete_volume" :: held 1.038s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:41 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Created reservations ['dafbb2de-4631-4318-99d0-7dd324422d18', 'e0fada45-a998-4432-8b9b-9b2690e854fb', 'cbd65e14-b39b-47ba-a4ba-fb40ce2ec38e', 'a037d353-51a3-45f6-ac09-1a73d91d34d6'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:42 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:42 devstack sudo[103914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:42 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-346d16fa-3027-4007-ba59-f078717a1be8 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-471666c5-de86-4609-838e-5604e1616cc5-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:42 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Deleted volume successfully.
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa2f136c-24d6-4b18-818c-5c827eefea37 tempest-ProjectReaderTests-306576214 None] Lock "cinder-72198d07-9d47-4834-9a06-adf2d00531cb-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce6dc4-a27e-4b7d-90de-3f418e4f1f47]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:42 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b
Sep 09 13:26:42 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:43 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" returned: 0 in 0.379s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:43 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b
Sep 09 13:26:43 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:43 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" returned: 0 in 0.301s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b" released by "delete_volume" :: held 0.720s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['2b4b6948-fb19-4be3-a05e-7ba001225b8e', '25ec2cc3-cd4d-414f-a9a0-a1ebc649d911', '0037e77f-6a51-41de-a249-748e7b3f1262', 'eddfc594-878d-4596-b8b5-8658182e6bde'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Flow 'volume_create_manager' (df65bcd2-8c2e-4327-80bd-d33c04236439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ffeb47-8514-4400-b35c-ac6050e7c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ffeb47-8514-4400-b35c-ac6050e7c14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062168999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aedea1f-c7ad-4a28-88d9-e68aa36b194e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb902b91eaa4f99b2c71f79dc52fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:43Z,use_quota=True,user_id='3b2aec2f1490452199f80ff84b0cb0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2298fdd5-b66e-444d-8e56-1a6e85e69373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2298fdd5-b66e-444d-8e56-1a6e85e69373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c785765b-978c-41e1-97b2-f5cbbbb6c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c785765b-978c-41e1-97b2-f5cbbbb6c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aedea1f-c7ad-4a28-88d9-e68aa36b194e', 'volume_name': 'volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b5562-278d-4b64-80f0-3d8a3ba29647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b5562-278d-4b64-80f0-3d8a3ba29647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e661542-e473-4305-a12a-70502e9b621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:43 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Volume 5aedea1f-c7ad-4a28-88d9-e68aa36b194e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e', 'volume_size': 1}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062168999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aedea1f-c7ad-4a28-88d9-e68aa36b194e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb902b91eaa4f99b2c71f79dc52fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:26:43Z,use_quota=True,user_id='3b2aec2f1490452199f80ff84b0cb0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Creating volume 5aedea1f-c7ad-4a28-88d9-e68aa36b194e {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:26:43 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:43 devstack sudo[103925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e 1073741824
Sep 09 13:26:43 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:43 devstack sudo[103927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:43 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-2e380a1a-b7d0-4a1f-ae83-f85554d1be81-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-2e380a1a-b7d0-4a1f-ae83-f85554d1be81-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2e8f6-20ac-4acf-a1d3-5c58fce45497]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:44 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.399s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-38818156-2607-4879-8748-e25edc722e0f tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-0c5692ea-c9da-4e40-89f2-09a1d9e8a41b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:44 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81
Sep 09 13:26:44 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:44 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e 1073741824" returned: 0 in 0.598s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:44 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e
Sep 09 13:26:44 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:44 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" returned: 0 in 0.475s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:44 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81
Sep 09 13:26:44 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:44 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" returned: 0 in 0.312s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e661542-e473-4305-a12a-70502e9b621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585050f-5ef1-4b93-86cf-8990276d1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:26:44 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Volume volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e (5aedea1f-c7ad-4a28-88d9-e68aa36b194e): created successfully
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585050f-5ef1-4b93-86cf-8990276d1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Flow 'volume_create_manager' (df65bcd2-8c2e-4327-80bd-d33c04236439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:26:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f0f16fb1-d9a4-4542-912d-eae96902869b tempest-ProjectReaderTests-306576214 None] Created volume successfully.
Sep 09 13:26:44 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-2e380a1a-b7d0-4a1f-ae83-f85554d1be81" released by "delete_volume" :: held 0.813s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['47b0fb74-0ba4-4b42-8c3b-e7927026c938', '60351049-7398-4243-828b-91071f999a58', '8f7639dc-d0e1-4143-8a23-02a345c65ba2', '1dcbe68e-7a2b-4026-9443-7cf4603a4927'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:44 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:44 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1599e02a-196a-482a-829a-62327fa722a0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:45 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.427s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:45 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3
Sep 09 13:26:45 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-598230d6-50da-414d-8865-eedc0531415a tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-2e380a1a-b7d0-4a1f-ae83-f85554d1be81-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Acquiring lock "cinder-5aedea1f-c7ad-4a28-88d9-e68aa36b194e-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:45 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" returned: 0 in 0.483s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "cinder-5aedea1f-c7ad-4a28-88d9-e68aa36b194e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:45 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3
Sep 09 13:26:45 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Acquiring lock "cinder-quobyte-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "cinder-quobyte-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a454424c-66a9-45ce-b5f5-c038c67c2ff9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:45 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e
Sep 09 13:26:45 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:46 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3" released by "delete_volume" :: held 0.856s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['3e0991af-bf6f-4e5b-a02e-00e718f7f1a8', '5680cc09-370b-45c5-b671-e422faf94a20', '280905f4-cbfb-4d63-8ae8-d724d2a378fb', '47c0a402-e07c-4734-ad7b-0e03d8bb7ab6'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:46 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:46 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:46 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" returned: 0 in 0.645s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:46 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e
Sep 09 13:26:46 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:46 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "cinder-quobyte-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.498s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" acquired by "delete_volume" :: waited 0.045s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-86173286-5c29-4c33-8555-c03cd1414bfa tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-1ab0e06b-a33c-4cd5-a3df-226af4ee95c3-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e8b3ae-e2a9-47d5-abe2-193adee10e0b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:46 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "cinder-quobyte-5aedea1f-c7ad-4a28-88d9-e68aa36b194e" released by "delete_volume" :: held 1.121s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:46 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe
Sep 09 13:26:46 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Created reservations ['f3d9e3ca-195f-44d1-9b31-bad9f88e8169', '404a5769-f18c-41ad-acd6-2738c58f8fd9', '706c8b3a-5748-4285-ac8e-d463218642ce', '51d90e39-3aa1-41b9-a169-33212bafa298'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:47 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:47 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:47 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" returned: 0 in 0.432s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:47 devstack sudo[103996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe
Sep 09 13:26:47 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:47 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Deleted volume successfully.
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6ca0cca6-56c3-4eba-a021-969a2d0ce7c0 tempest-ProjectReaderTests-306576214 None] Lock "cinder-5aedea1f-c7ad-4a28-88d9-e68aa36b194e-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:47 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-quobyte-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe" released by "delete_volume" :: held 0.788s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Created reservations ['2a2fa024-d49e-4f0c-9388-1ca4c58eb5fc', '3426c14c-e85a-4680-b7d7-1908ee0260b5', '564575d4-a619-4340-ac28-32e307b35d10', '1f43457d-ca76-414f-813e-875a6c2de54c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:47 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:26:47 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:47 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.298s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:26:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Deleted volume successfully.
Sep 09 13:26:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-07a959d4-a865-4fa0-99df-b850008569c6 tempest-CreateVolumesFromSourceVolumeTest-973899546 None] Lock "cinder-e04b2222-fb91-4654-8b07-fc3c0d1bbbfe-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b28f1e7e-716c-422a-8734-0a58e2204305 tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" by "attach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b28f1e7e-716c-422a-8734-0a58e2204305 tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" acquired by "attach_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b28f1e7e-716c-422a-8734-0a58e2204305 tempest-VolumesActionsTest-488506953 None] Attaching volume 97e2d9fe-b130-413f-8967-8409dd1bcaea to instance 61b71667-7af6-4c94-a0bb-2a59446899de at mountpoint /dev/vdb on host None.
Sep 09 13:26:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b28f1e7e-716c-422a-8734-0a58e2204305 tempest-VolumesActionsTest-488506953 None] Attach volume completed successfully.
Sep 09 13:26:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b28f1e7e-716c-422a-8734-0a58e2204305 tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea" released by "attach_volume" :: held 0.147s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-901885dc-8696-4cc3-91ef-0d399f01c27f tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" by "detach_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:26:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-901885dc-8696-4cc3-91ef-0d399f01c27f tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:26:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-901885dc-8696-4cc3-91ef-0d399f01c27f tempest-VolumesActionsTest-488506953 None] Detaching volume 97e2d9fe-b130-413f-8967-8409dd1bcaea from instance 61b71667-7af6-4c94-a0bb-2a59446899de.
Sep 09 13:26:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-901885dc-8696-4cc3-91ef-0d399f01c27f tempest-VolumesActionsTest-488506953 None] Detach volume completed successfully.
Sep 09 13:26:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-901885dc-8696-4cc3-91ef-0d399f01c27f tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:26:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:26:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:26:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b47d7-3cca-451c-9490-84cf0da02573]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:57 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:26:57 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:58 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:58 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb6076-5cd8-4984-8a76-60668306f1d1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:26:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:58 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:26:58 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:26:58 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 09 13:26:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:26:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.802d2c7f-b198-406b-ac7d-b65f1c8a9371kjcy5xv0.img {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:26:58 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.802d2c7f-b198-406b-ac7d-b65f1c8a9371kjcy5xv0.img
Sep 09 13:26:58 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:02 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:27:03 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.802d2c7f-b198-406b-ac7d-b65f1c8a9371kjcy5xv0.img" returned: 0 in 4.709s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5236195b-2850-4ebb-825f-3a83fd890b7c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:03 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:03 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:03 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.581s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.802d2c7f-b198-406b-ac7d-b65f1c8a9371kjcy5xv0.img {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:27:03 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Converted 1024.00 MB image at 217.35 MB/s
Sep 09 13:27:03 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] 802d2c7f-b198-406b-ac7d-b65f1c8a9371 was raw, no need to convert to raw {{(pid=87606) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 09 13:27:13 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:27:13 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:INSERT=18,cinder:UPDATE=62,cinder:SELECT=39,cinder:DELETE=6 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Flow 'volume_create_manager' (060518a9-7fcd-4ecd-a9f2-8d79ff49f3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de705666-bc81-4883-a50a-2e198d8cf70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de705666-bc81-4883-a50a-2e198d8cf70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-601497705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8fcddb-98c8-4d27-8bd0-96d5059d412f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e232fe9f18f14900ad9247a4d0292955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:27:23Z,use_quota=True,user_id='d1d77eda48e442a5ba7db7a85ac6c2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a4bcd5-ae39-4fa6-a736-69855f626dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a4bcd5-ae39-4fa6-a736-69855f626dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c404316a-41d2-43e8-ae26-11f157086883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c404316a-41d2-43e8-ae26-11f157086883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8fcddb-98c8-4d27-8bd0-96d5059d412f', 'volume_name': 'volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a132d2fc-054f-4cd5-a67f-52a03922e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a132d2fc-054f-4cd5-a67f-52a03922e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc9bfed-0c10-4496-a906-2548de290b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Volume 9f8fcddb-98c8-4d27-8bd0-96d5059d412f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f', 'volume_size': 1}
Sep 09 13:27:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.250s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Uploaded volume to glance image-id: 802d2c7f-b198-406b-ac7d-b65f1c8a9371. {{(pid=87606) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.333s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-601497705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8fcddb-98c8-4d27-8bd0-96d5059d412f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e232fe9f18f14900ad9247a4d0292955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:27:23Z,use_quota=True,user_id='d1d77eda48e442a5ba7db7a85ac6c2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Creating volume 9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:27:25 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:25 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f 1073741824
Sep 09 13:27:25 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3e0d26d3-7d2c-4763-88ee-97c8585719cd tempest-VolumesActionsTest-488506953 None] Copy volume to image completed successfully.
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:25 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:27:25 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:25 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f 1073741824" returned: 0 in 0.398s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:25 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:25 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:25 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.254s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:27:25 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.254s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc9bfed-0c10-4496-a906-2548de290b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e255f6-3fbe-4192-928c-a6f2517ed861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Volume volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f (9f8fcddb-98c8-4d27-8bd0-96d5059d412f): created successfully
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e255f6-3fbe-4192-928c-a6f2517ed861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Flow 'volume_create_manager' (060518a9-7fcd-4ecd-a9f2-8d79ff49f3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:27:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a4966e99-2ec9-4c40-bd9b-84d1ab63fdcd tempest-SnapshotDependencyTests-161539906 None] Created volume successfully.
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a18614-a594-4ce2-979a-d79305a96dc5]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:27 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:27 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:27 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa198e8-d7ac-4d86-8f2f-701ea2f50380]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:27 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:27 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:27 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:27 devstack sudo[104192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img
Sep 09 13:27:27 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:31 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img" returned: 0 in 4.085s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a538a-cebc-4436-bb29-81b8a68844e5]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:31 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:31 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:32 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.516s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:27:32 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Converted 1024.00 MB image at 250.58 MB/s
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] 025495c0-858d-4490-9036-47497bedbc82 was raw, converting to qcow2 {{(pid=87606) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c6935e-dfef-4c91-9b0d-d4e93d1f437b]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:32 devstack sudo[104219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img
Sep 09 13:27:32 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:32 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img" returned: 0 in 0.315s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:32 devstack sudo[104223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img
Sep 09 13:27:32 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:33 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img" returned: 1 in 0.313s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:33 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0
Sep 09 13:27:33 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:33 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Image conversion details: src /opt/stack/data/cinder/conversion/97e2d9fe-b130-413f-8967-8409dd1bcaea.temp_image.025495c0-858d-4490-9036-47497bedbc82fwhzhfrn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:27:33 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c034615b-c7b2-49a6-a5e9-308e3577f2a9]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:33 devstack sudo[104233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0
Sep 09 13:27:33 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:33 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_51x3x4o0" returned: 0 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.774s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Uploaded volume to glance image-id: 025495c0-858d-4490-9036-47497bedbc82. {{(pid=87606) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.724s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Creating offline snapshot dc97a1dd-ce33-47f2-9431-f1504d86e764 of volume 9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:27:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-df3caba6-9b22-496d-b464-2536951fb8fe tempest-VolumesActionsTest-488506953 None] Copy volume to image completed successfully.
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4bdd7c-a8f6-4415-acfb-9b8ec8b75ec8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:34 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:34 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:35 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:35 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 1G
Sep 09 13:27:35 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:35 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 1G" returned: 0 in 0.440s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:35 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:35 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:35 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.326s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:35 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 is being set with open permissions: ugo+rw
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:35 devstack sudo[104253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:35 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Acquiring lock "cinder-quobyte-97e2d9fe-b130-413f-8967-8409dd1bcaea" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "cinder-quobyte-97e2d9fe-b130-413f-8967-8409dd1bcaea" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e42759-7c8b-4f77-9cc0-da7a56a55121]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:36 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:36 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:36 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:36 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info
Sep 09 13:27:36 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:36 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.366s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:36 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea
Sep 09 13:27:36 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:36 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:36 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info is being set with open permissions: ugo+rw
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:36 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info
Sep 09 13:27:36 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:36 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-97e2d9fe-b130-413f-8967-8409dd1bcaea" returned: 0 in 0.249s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "cinder-quobyte-97e2d9fe-b130-413f-8967-8409dd1bcaea" released by "delete_volume" :: held 0.655s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:36 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.info" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Created reservations ['4b403717-a363-4eab-8900-e3f15e867979', 'f2f7ea37-e112-43dd-8c1a-be1cd4939c99', '0f754f1e-3126-41fc-8a5d-97f7fd768625', '1f996d79-b32c-4c48-85a0-261f14355021'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:27:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-917ebf7d-fbfe-48eb-b80e-93adf1937149 tempest-SnapshotDependencyTests-161539906 None] Create snapshot completed successfully
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:36 devstack sudo[104270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:27:36 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:37 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:37 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:27:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Deleted volume successfully.
Sep 09 13:27:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-fa71293c-f5aa-46bf-aabe-bf05366aad21 tempest-VolumesActionsTest-488506953 None] Lock "cinder-97e2d9fe-b130-413f-8967-8409dd1bcaea-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Flow 'volume_create_manager' (3d02eb6e-6df0-4904-bf7e-79e908a138a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed738b6-0548-4323-bc0f-4aabe0344cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed738b6-0548-4323-bc0f-4aabe0344cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb624964-9e66-4ac2-9761-84cd927dead6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e232fe9f18f14900ad9247a4d0292955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc97a1dd-ce33-47f2-9431-f1504d86e764,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:27:38Z,use_quota=True,user_id='d1d77eda48e442a5ba7db7a85ac6c2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c8ad2a-4fe4-4f31-943b-20b0045771ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c8ad2a-4fe4-4f31-943b-20b0045771ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc566740-3ed1-43f6-bd9c-c4f086d93e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc566740-3ed1-43f6-bd9c-c4f086d93e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb624964-9e66-4ac2-9761-84cd927dead6', 'volume_name': 'volume-bb624964-9e66-4ac2-9761-84cd927dead6', 'volume_size': 1, 'snapshot_id': 'dc97a1dd-ce33-47f2-9431-f1504d86e764'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3effd-7c23-45d2-be77-1bafcff47078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3effd-7c23-45d2-be77-1bafcff47078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd96697c-2ea5-4309-bf6c-bc5f6c3cdb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Volume bb624964-9e66-4ac2-9761-84cd927dead6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb624964-9e66-4ac2-9761-84cd927dead6', 'volume_size': 1, 'snapshot_id': 'dc97a1dd-ce33-47f2-9431-f1504d86e764'}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764-bb624964-9e66-4ac2-9761-84cd927dead6" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764-bb624964-9e66-4ac2-9761-84cd927dead6" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Creating volume bb624964-9e66-4ac2-9761-84cd927dead6 from snapshot dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] snapshot: dc97a1dd-ce33-47f2-9431-f1504d86e764, volume: bb624964-9e66-4ac2-9761-84cd927dead6,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f7bfca-018a-4423-a99a-34c999e20088]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:38 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:38 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:38 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[118cedbb-1566-4861-b80f-4ede769213bb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:39 devstack sudo[104280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:39 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:39 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:27:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:27:39 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:27:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:39 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6
Sep 09 13:27:39 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:44 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6" returned: 0 in 4.742s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:27:44 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Converted 1024.00 MB image at 215.86 MB/s
Sep 09 13:27:44 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 is being set with open permissions: ugo+rw
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:44 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6
Sep 09 13:27:44 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:44 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6" returned: 0 in 0.266s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" released by "_copy_volume_from_snapshot" :: held 5.884s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764-bb624964-9e66-4ac2-9761-84cd927dead6" released by "_create_volume_from_snapshot" :: held 5.961s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.979s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd96697c-2ea5-4309-bf6c-bc5f6c3cdb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb624964-9e66-4ac2-9761-84cd927dead6', 'volume_size': 1, 'snapshot_id': 'dc97a1dd-ce33-47f2-9431-f1504d86e764'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bfde95-f2a3-4d5b-8afe-3f45b823245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:27:44 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Volume volume-bb624964-9e66-4ac2-9761-84cd927dead6 (bb624964-9e66-4ac2-9761-84cd927dead6): created successfully
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bfde95-f2a3-4d5b-8afe-3f45b823245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:27:44 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Flow 'volume_create_manager' (3d02eb6e-6df0-4904-bf7e-79e908a138a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:27:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ce9fa731-7314-4a62-a945-e6c576bf0f3e tempest-SnapshotDependencyTests-161539906 None] Created volume successfully.
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-dc97a1dd-ce33-47f2-9431-f1504d86e764-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-dc97a1dd-ce33-47f2-9431-f1504d86e764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Deleting offline snapshot dc97a1dd-ce33-47f2-9431-f1504d86e764 of volume 9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] snapshot_file for this snap is: volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95e80f-8219-463a-9fbf-975ff4677e69]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:45 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:45 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:45 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.373s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[509683ae-375b-4e7d-9d81-d26946c270be]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:45 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:45 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:46 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.546s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:46 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:46 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:46 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:46 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764
Sep 09 13:27:46 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:46 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f.dc97a1dd-ce33-47f2-9431-f1504d86e764" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-dc97a1dd-ce33-47f2-9431-f1504d86e764" released by "_delete_snapshot" :: held 1.713s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" released by "delete_snapshot" :: held 1.740s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Created reservations ['a4feb7c2-1126-48c7-908e-7f4f44ba9547', 'a9005d5a-bdfa-4d3b-9eca-0245661f7620', '1147cad2-5a76-4bb4-93c7-f089b3f2f82c', '199676a8-754a-46ab-b8a8-c6be7d3e4001'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:27:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Delete snapshot completed successfully.
Sep 09 13:27:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-807862c3-c98e-4af9-b7b0-431ab28f237d tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-dc97a1dd-ce33-47f2-9431-f1504d86e764-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-9f8fcddb-98c8-4d27-8bd0-96d5059d412f-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-9f8fcddb-98c8-4d27-8bd0-96d5059d412f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650901e-6e63-40ee-8dfa-a73f5f8e5129]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:47 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:47 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:47 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:47 devstack sudo[104327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f
Sep 09 13:27:47 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:47 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" returned: 0 in 0.254s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-9f8fcddb-98c8-4d27-8bd0-96d5059d412f" released by "delete_volume" :: held 0.713s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Created reservations ['a49f14e6-2c84-491d-bc79-15d0acf2964a', '1a6ee35c-7d64-42be-9f0d-4909f7927936', 'a28dd60a-d622-4c56-a540-f3d4953f2cc0', 'b9e3ada8-43f1-4cf0-914e-d1e7662010b3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:48 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:27:48 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:48 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:27:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Deleted volume successfully.
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-470f4c23-b046-4c79-9813-8949a072d330 tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-9f8fcddb-98c8-4d27-8bd0-96d5059d412f-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-bb624964-9e66-4ac2-9761-84cd927dead6-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-bb624964-9e66-4ac2-9761-84cd927dead6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb925eae-472e-41b1-8dde-e02f7bb8ffed]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:48 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6
Sep 09 13:27:48 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:48 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:48 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6
Sep 09 13:27:48 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:49 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-bb624964-9e66-4ac2-9761-84cd927dead6" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-quobyte-bb624964-9e66-4ac2-9761-84cd927dead6" released by "delete_volume" :: held 0.699s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Created reservations ['8524fe16-aa8a-4a61-a7f1-bbacf512e260', '455d108c-d932-4df5-8b79-b4cf4698bc45', '63c637fd-21b4-4a55-aba5-0030d223ed35', 'e825ff26-a566-42a3-8b0d-d894967a210a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:27:49 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:27:49 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:27:49 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.250s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:27:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Deleted volume successfully.
Sep 09 13:27:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-59061810-1ceb-41a6-b1b5-3278b70b912c tempest-SnapshotDependencyTests-161539906 None] Lock "cinder-bb624964-9e66-4ac2-9761-84cd927dead6-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:27:59 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=39,cinder:SELECT=34,cinder:DELETE=5,cinder:INSERT=10 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:27:59 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (c470d04a-0d04-452c-8247-39c1a4897626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02dc5b-522a-4ba1-8e4e-0f45d35ea371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02dc5b-522a-4ba1-8e4e-0f45d35ea371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447720949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89eecca8-15f6-4eff-8796-624a7c898054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:08Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(586ad03a-e229-46b2-89e3-73bc157dc5dc),volume_type_id=586ad03a-e229-46b2-89e3-73bc157dc5dc)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee82fdeb-9308-4d1a-a794-df8f3ab4c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee82fdeb-9308-4d1a-a794-df8f3ab4c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1af55f-6346-46bd-a86e-f9b73db66324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1af55f-6346-46bd-a86e-f9b73db66324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89eecca8-15f6-4eff-8796-624a7c898054', 'volume_name': 'volume-89eecca8-15f6-4eff-8796-624a7c898054', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f17f49-8dc2-44fa-acf7-c525af95fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f17f49-8dc2-44fa-acf7-c525af95fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f9932-ac14-420c-9543-b5bc67c27f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume 89eecca8-15f6-4eff-8796-624a7c898054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89eecca8-15f6-4eff-8796-624a7c898054', 'volume_size': 1}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447720949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89eecca8-15f6-4eff-8796-624a7c898054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:08Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(586ad03a-e229-46b2-89e3-73bc157dc5dc),volume_type_id=586ad03a-e229-46b2-89e3-73bc157dc5dc)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Creating volume 89eecca8-15f6-4eff-8796-624a7c898054 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:28:08 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:08 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 1073741824
Sep 09 13:28:08 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (cf1bf140-b9e3-44fb-a30d-5330aa06c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bd1a84-9d66-482a-9aff-9d58ed282960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bd1a84-9d66-482a-9aff-9d58ed282960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1408900262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd095ee-54b1-4170-9279-9d4622f03388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:08Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69360822-605c-45e1-a47e-819ee31d685e),volume_type_id=69360822-605c-45e1-a47e-819ee31d685e)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a45de12-3d74-47cc-855d-ff856083b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a45de12-3d74-47cc-855d-ff856083b512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39440fc3-fb5d-4946-b837-b2d44465c059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39440fc3-fb5d-4946-b837-b2d44465c059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd095ee-54b1-4170-9279-9d4622f03388', 'volume_name': 'volume-1dd095ee-54b1-4170-9279-9d4622f03388', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a937deaf-ca8a-48f7-bd6f-ca5bcedc9db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a937deaf-ca8a-48f7-bd6f-ca5bcedc9db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b47d084-f599-43d9-be20-b70da02c1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:08 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume 1dd095ee-54b1-4170-9279-9d4622f03388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd095ee-54b1-4170-9279-9d4622f03388', 'volume_size': 1}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:08 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 1073741824" returned: 0 in 0.482s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:08 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054
Sep 09 13:28:08 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:08 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1408900262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd095ee-54b1-4170-9279-9d4622f03388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:08Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69360822-605c-45e1-a47e-819ee31d685e),volume_type_id=69360822-605c-45e1-a47e-819ee31d685e)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Creating volume 1dd095ee-54b1-4170-9279-9d4622f03388 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:28:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777f9932-ac14-420c-9543-b5bc67c27f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89eecca8-15f6-4eff-8796-624a7c898054', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 1073741824
Sep 09 13:28:09 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a66d856-ee22-49c8-b974-e54fcb7b5c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume volume-89eecca8-15f6-4eff-8796-624a7c898054 (89eecca8-15f6-4eff-8796-624a7c898054): created successfully
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a66d856-ee22-49c8-b974-e54fcb7b5c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (c470d04a-0d04-452c-8247-39c1a4897626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (1bfcbf72-6b78-4b41-b1ac-95055e345f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956036d-d41c-45fe-b766-8b5b607e2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a72d302f-bb26-4907-8a0c-1554ed2b7f3b tempest-TestInstancesWithCinderVolumes-1004955530 None] Created volume successfully.
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956036d-d41c-45fe-b766-8b5b607e2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1354729461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac1d84e-9aba-47e0-ac41-b0eb1d80506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:09Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce99145f-f0ed-454f-9abb-68b96dfa2b9b),volume_type_id=ce99145f-f0ed-454f-9abb-68b96dfa2b9b)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1447ef7-597e-47ff-98a5-35d84f30c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1447ef7-597e-47ff-98a5-35d84f30c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbc6a9c-14c6-4ff7-a8cd-496ebd2d7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:28:09 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 1073741824" returned: 0 in 0.427s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbc6a9c-14c6-4ff7-a8cd-496ebd2d7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aac1d84e-9aba-47e0-ac41-b0eb1d80506f', 'volume_name': 'volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f', 'volume_size': 1, 'image_id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1076942168', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6489642b52fd4c79b397099db7d072bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'created_at': datetime.datetime(2026, 9, 9, 11, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72b60b85-bae8-4e25-9f2e-129c065f919b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545ec9910>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e8b981-b6f5-473d-ad3f-aad52072d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e8b981-b6f5-473d-ad3f-aad52072d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d0ade0-ace5-4f40-94d2-1734bb39114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f', 'volume_size': 1, 'image_id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1076942168', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6489642b52fd4c79b397099db7d072bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'created_at': datetime.datetime(2026, 9, 9, 11, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72b60b85-bae8-4e25-9f2e-129c065f919b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545ec9910>}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Trying to clone aac1d84e-9aba-47e0-ac41-b0eb1d80506f from image 72b60b85-bae8-4e25-9f2e-129c065f919b at location (None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:09 devstack sudo[104366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388
Sep 09 13:28:09 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:09 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b47d084-f599-43d9-be20-b70da02c1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd095ee-54b1-4170-9279-9d4622f03388', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69061808-6a60-4fcb-9df7-ee320bc4fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume volume-1dd095ee-54b1-4170-9279-9d4622f03388 (1dd095ee-54b1-4170-9279-9d4622f03388): created successfully
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69061808-6a60-4fcb-9df7-ee320bc4fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:09 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (cf1bf140-b9e3-44fb-a30d-5330aa06c441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-28aa49ad-d717-4411-846f-299759589d54 tempest-TestInstancesWithCinderVolumes-1004955530 None] Created volume successfully.
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD, size 20.69 MB, duration 2.85 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:28:12 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Image download 20.69 MB at 7.27 MB/s
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a448c82c-0bde-4da3-a1b4-3ab778c4f06b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:12 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD
Sep 09 13:28:12 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:12 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Temporary image 72b60b85-bae8-4e25-9f2e-129c065f919b is fetched for user 3b4cc8363a4a42e0b461b026dd6d96ad. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d825e9e-ed3c-4bbd-92a8-d5d2f66e40e8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:28:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:12 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD
Sep 09 13:28:12 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:13 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1354729461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac1d84e-9aba-47e0-ac41-b0eb1d80506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6489642b52fd4c79b397099db7d072bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:28:09Z,use_quota=True,user_id='3b4cc8363a4a42e0b461b026dd6d96ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce99145f-f0ed-454f-9abb-68b96dfa2b9b),volume_type_id=ce99145f-f0ed-454f-9abb-68b96dfa2b9b)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Creating volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:28:13 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:13 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1073741824
Sep 09 13:28:13 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:13 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1073741824" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:13 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f
Sep 09 13:28:13 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:13 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Attempting download of 72b60b85-bae8-4e25-9f2e-129c065f919b ((None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}])) to volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fcec1c-9a42-4aba-a0d9-ee68106f2e5e]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:28:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:13 devstack sudo[104390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa
Sep 09 13:28:13 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:14 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa" returned: 0 in 0.321s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:14 devstack sudo[104394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa
Sep 09 13:28:14 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:14 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa" returned: 1 in 0.322s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72b60b85-bae8-4e25-9f2e-129c065f919b_poyylcwa' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee135e-0cb0-438d-858f-7faede55f692]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:14 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD
Sep 09 13:28:14 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:14 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] 72b60b85-bae8-4e25-9f2e-129c065f919b was qcow2, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:28:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:14 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f
Sep 09 13:28:14 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:16 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" returned: 0 in 1.547s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72b60b85-bae8-4e25-9f2e-129c065f919b_ql5sqfr7devstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:28:16 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Converted 112.00 MB image at 72.32 MB/s
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:16 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1G
Sep 09 13:28:16 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:16 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f 1G" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Downloaded image 72b60b85-bae8-4e25-9f2e-129c065f919b ((None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}])) to volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Temporary image 72b60b85-bae8-4e25-9f2e-129c065f919b for user 3b4cc8363a4a42e0b461b026dd6d96ad is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Marking volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Copying metadata from image 72b60b85-bae8-4e25-9f2e-129c065f919b to aac1d84e-9aba-47e0-ac41-b0eb1d80506f. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Creating volume glance metadata for volume aac1d84e-9aba-47e0-ac41-b0eb1d80506f backed by image 72b60b85-bae8-4e25-9f2e-129c065f919b with: {'image_id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'image_name': 'tempest-scenario-img--1076942168', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d0ade0-ace5-4f40-94d2-1734bb39114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f', 'volume_size': 1, 'image_id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72b60b85-bae8-4e25-9f2e-129c065f919b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1076942168', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6489642b52fd4c79b397099db7d072bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72b60b85-bae8-4e25-9f2e-129c065f919b', 'created_at': datetime.datetime(2026, 9, 9, 11, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72b60b85-bae8-4e25-9f2e-129c065f919b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab545ec9910>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b44ffa-a52c-4925-bfbc-46cd8b906e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:28:16 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Volume volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f (aac1d84e-9aba-47e0-ac41-b0eb1d80506f): created successfully
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b44ffa-a52c-4925-bfbc-46cd8b906e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:28:16 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Flow 'volume_create_manager' (1bfcbf72-6b78-4b41-b1ac-95055e345f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:28:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6cd006a9-e98c-4d4f-a125-33315fe64571 tempest-TestInstancesWithCinderVolumes-1004955530 None] Created volume successfully.
Sep 09 13:28:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1bac9f18-8573-4694-9003-3ec9f72093f6 req-6937910b-ab41-4842-a8d1-a71ef1bbaaf9 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1bac9f18-8573-4694-9003-3ec9f72093f6 req-6937910b-ab41-4842-a8d1-a71ef1bbaaf9 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-1bac9f18-8573-4694-9003-3ec9f72093f6 req-6937910b-ab41-4842-a8d1-a71ef1bbaaf9 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-1bac9f18-8573-4694-9003-3ec9f72093f6 req-6937910b-ab41-4842-a8d1-a71ef1bbaaf9 tempest-TestInstancesWithCinderVolumes-1004955530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '287eb290-08b7-4cf7-82a7-52bf7ca3f65f', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:28:20 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-1bac9f18-8573-4694-9003-3ec9f72093f6 req-6937910b-ab41-4842-a8d1-a71ef1bbaaf9 tempest-TestInstancesWithCinderVolumes-1004955530 None] attachment_update completed successfully.
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:25 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:28:25 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:25 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:28:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:28:30 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=12,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:28:30 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:28:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-a8561ac5-f30c-4dc4-beac-b656d9da054a req-299c2a2e-8705-41bc-b72a-35ad39ac4c9f tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-a8561ac5-f30c-4dc4-beac-b656d9da054a req-299c2a2e-8705-41bc-b72a-35ad39ac4c9f tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-a8561ac5-f30c-4dc4-beac-b656d9da054a req-299c2a2e-8705-41bc-b72a-35ad39ac4c9f tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-a8561ac5-f30c-4dc4-beac-b656d9da054a req-299c2a2e-8705-41bc-b72a-35ad39ac4c9f tempest-TestInstancesWithCinderVolumes-1004955530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-89eecca8-15f6-4eff-8796-624a7c898054', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd18a0319-d03d-4814-8814-300cb800e75c', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:28:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-a8561ac5-f30c-4dc4-beac-b656d9da054a req-299c2a2e-8705-41bc-b72a-35ad39ac4c9f tempest-TestInstancesWithCinderVolumes-1004955530 None] attachment_update completed successfully.
Sep 09 13:28:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-840c74f6-e489-4cf2-a494-deb2c6b950b3 req-b0b967cf-1682-4305-b6c3-b0806583dbf6 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-840c74f6-e489-4cf2-a494-deb2c6b950b3 req-b0b967cf-1682-4305-b6c3-b0806583dbf6 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-840c74f6-e489-4cf2-a494-deb2c6b950b3 req-b0b967cf-1682-4305-b6c3-b0806583dbf6 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-840c74f6-e489-4cf2-a494-deb2c6b950b3 req-b0b967cf-1682-4305-b6c3-b0806583dbf6 tempest-TestInstancesWithCinderVolumes-1004955530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-1dd095ee-54b1-4170-9279-9d4622f03388', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37c823c1-68c1-462b-a499-04eabf930734', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:28:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-840c74f6-e489-4cf2-a494-deb2c6b950b3 req-b0b967cf-1682-4305-b6c3-b0806583dbf6 tempest-TestInstancesWithCinderVolumes-1004955530 None] attachment_update completed successfully.
Sep 09 13:28:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-c27b484b-385d-4e65-8c23-711d6a28ea33 req-141a9abf-b04c-4d72-acd5-23c63266cc4e tempest-TestInstancesWithCinderVolumes-1004955530 None] Terminate volume connection completed successfully.
Sep 09 13:28:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-c27b484b-385d-4e65-8c23-711d6a28ea33 req-141a9abf-b04c-4d72-acd5-23c63266cc4e tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleting attachment d18a0319-d03d-4814-8814-300cb800e75c. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-89eecca8-15f6-4eff-8796-624a7c898054-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-89eecca8-15f6-4eff-8796-624a7c898054-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-quobyte-89eecca8-15f6-4eff-8796-624a7c898054" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-89eecca8-15f6-4eff-8796-624a7c898054" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de6512-cb35-44dc-a527-d2984a7d7e23]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:28:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:57 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054
Sep 09 13:28:57 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:58 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:58 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054
Sep 09 13:28:58 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:58 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-89eecca8-15f6-4eff-8796-624a7c898054" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-89eecca8-15f6-4eff-8796-624a7c898054" released by "delete_volume" :: held 0.695s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:28:58 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894025383-3246351 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894025383-3246351, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:28:58 devstack cinder-volume[87606]: WARNING cinder.quota [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894025383-3246351 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1894025383-3246351, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Created reservations ['469331c8-6e8f-4883-8ee2-e8a347935509', '21d23ab6-3d0d-4400-8430-f23124fe96b9', 'a192d5bc-31f7-4320-a385-3e7143039266', '717b4baa-1563-434a-9ff2-b796fd517055'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:28:58 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:28:58 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:28:58 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:28:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleted volume successfully.
Sep 09 13:28:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b9d462da-6136-45bd-a355-11ae066d15d5 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-89eecca8-15f6-4eff-8796-624a7c898054-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:29:00 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-87b8c33b-3093-4a86-a5ab-5d1b720ef02e req-1f85cc04-777a-4f3b-a0c9-e613caa870f0 tempest-TestInstancesWithCinderVolumes-1004955530 None] Terminate volume connection completed successfully.
Sep 09 13:29:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-87b8c33b-3093-4a86-a5ab-5d1b720ef02e req-1f85cc04-777a-4f3b-a0c9-e613caa870f0 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleting attachment 37c823c1-68c1-462b-a499-04eabf930734. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-1dd095ee-54b1-4170-9279-9d4622f03388-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-1dd095ee-54b1-4170-9279-9d4622f03388-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-quobyte-1dd095ee-54b1-4170-9279-9d4622f03388" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-1dd095ee-54b1-4170-9279-9d4622f03388" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb71f55-079e-42e9-9390-5b6cb34944f1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:29:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:01 devstack sudo[105080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388
Sep 09 13:29:01 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:02 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388" returned: 0 in 0.373s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:02 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388
Sep 09 13:29:02 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:02 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1dd095ee-54b1-4170-9279-9d4622f03388" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-1dd095ee-54b1-4170-9279-9d4622f03388" released by "delete_volume" :: held 0.667s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:29:02 devstack cinder-volume[87606]: WARNING cinder.quota [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517926073-1163378119 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517926073-1163378119, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:29:02 devstack cinder-volume[87606]: WARNING cinder.quota [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517926073-1163378119 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-517926073-1163378119, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Created reservations ['3bbe2414-8513-4fa4-b675-8e7eae6070a1', '7024e674-ae87-40b7-915f-1b94876ef6bf', '560306fa-acbe-4f41-8716-2921e0985e32', 'ea84bb08-3a36-4421-876f-2c452c4364f1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:02 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:29:02 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:02 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:29:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleted volume successfully.
Sep 09 13:29:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9e06cb0-1443-4092-93f3-2aa98eba6df7 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-1dd095ee-54b1-4170-9279-9d4622f03388-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:29:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-a167fea9-6cbf-4054-9091-75d95ca6284a req-1eebe881-92dc-4334-b304-93d1fd8cbb4b tempest-TestInstancesWithCinderVolumes-1004955530 None] Terminate volume connection completed successfully.
Sep 09 13:29:05 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-a167fea9-6cbf-4054-9091-75d95ca6284a req-1eebe881-92dc-4334-b304-93d1fd8cbb4b tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleting attachment 287eb290-08b7-4cf7-82a7-52bf7ca3f65f. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-aac1d84e-9aba-47e0-ac41-b0eb1d80506f-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-aac1d84e-9aba-47e0-ac41-b0eb1d80506f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "cinder-quobyte-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d3beba-9de9-4aea-86b3-fcf1e651b2b3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:06 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f
Sep 09 13:29:06 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:06 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:06 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f
Sep 09 13:29:06 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:06 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-quobyte-aac1d84e-9aba-47e0-ac41-b0eb1d80506f" released by "delete_volume" :: held 0.640s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:29:06 devstack cinder-volume[87606]: WARNING cinder.quota [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-516840094-1784998125 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-516840094-1784998125, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:29:06 devstack cinder-volume[87606]: WARNING cinder.quota [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-516840094-1784998125 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-516840094-1784998125, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Created reservations ['139d8f51-21f2-4637-84f1-631570d34ca7', '3f40d777-4b98-42a5-a6e8-8367f9cb9648', 'db578a41-0622-42d5-bbac-3646eccd886a', 'abe460a5-fcbc-46a6-b28e-b02e5d005ec4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:07 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:29:07 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:07 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.239s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:29:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Deleted volume successfully.
Sep 09 13:29:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0724fe09-6591-4de2-be5d-db7cc0c22709 tempest-TestInstancesWithCinderVolumes-1004955530 None] Lock "cinder-aac1d84e-9aba-47e0-ac41-b0eb1d80506f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:29:17 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=31,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:29:17 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:25 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:29:25 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:25 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:29:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:29:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:29:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Flow 'volume_create_manager' (abb92544-f935-4eab-bcc9-4bc6b9a24af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c85261-e04b-424c-9c5f-60d4c284ef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c85261-e04b-424c-9c5f-60d4c284ef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1103279126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4047f94d-a58c-45e8-a89f-118bf83a6501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08141d5b3332489ca7bfaa69594b890e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:29:38Z,use_quota=True,user_id='90ef0215ecc6447d900489e1402b8583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd39e713-1b48-46bb-be5f-bfba722b4fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd39e713-1b48-46bb-be5f-bfba722b4fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3eb518-290c-411c-8e0c-7f3b4ae95916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3eb518-290c-411c-8e0c-7f3b4ae95916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4047f94d-a58c-45e8-a89f-118bf83a6501', 'volume_name': 'volume-4047f94d-a58c-45e8-a89f-118bf83a6501', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145bbce-d37c-4138-8eb9-82047878f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1145bbce-d37c-4138-8eb9-82047878f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0942f825-e83c-487d-b4cb-f025dfe57b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Volume 4047f94d-a58c-45e8-a89f-118bf83a6501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4047f94d-a58c-45e8-a89f-118bf83a6501', 'volume_size': 1}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1103279126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4047f94d-a58c-45e8-a89f-118bf83a6501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08141d5b3332489ca7bfaa69594b890e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:29:38Z,use_quota=True,user_id='90ef0215ecc6447d900489e1402b8583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Creating volume 4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:29:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:38 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 1073741824
Sep 09 13:29:38 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:38 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 1073741824" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:29:38 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:29:38 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:29:39 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0942f825-e83c-487d-b4cb-f025dfe57b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4047f94d-a58c-45e8-a89f-118bf83a6501', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf0d173-3eb2-4143-bf78-cdfcc654c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:29:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Volume volume-4047f94d-a58c-45e8-a89f-118bf83a6501 (4047f94d-a58c-45e8-a89f-118bf83a6501): created successfully
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf0d173-3eb2-4143-bf78-cdfcc654c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:29:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Flow 'volume_create_manager' (abb92544-f935-4eab-bcc9-4bc6b9a24af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:29:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4c69c718-0cc8-41d7-b6fd-5e076e52f244 tempest-TestStampPattern-684927933 None] Created volume successfully.
Sep 09 13:29:49 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:29:49 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:30:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-895a26d5-a00e-44cb-be0b-99d9e39c1b16 req-f55c0ba1-45a4-4811-ac50-7cdd18b7ad28 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-895a26d5-a00e-44cb-be0b-99d9e39c1b16 req-f55c0ba1-45a4-4811-ac50-7cdd18b7ad28 tempest-TestStampPattern-684927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-895a26d5-a00e-44cb-be0b-99d9e39c1b16 req-f55c0ba1-45a4-4811-ac50-7cdd18b7ad28 tempest-TestStampPattern-684927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:08 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-895a26d5-a00e-44cb-be0b-99d9e39c1b16 req-f55c0ba1-45a4-4811-ac50-7cdd18b7ad28 tempest-TestStampPattern-684927933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-4047f94d-a58c-45e8-a89f-118bf83a6501', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84ad7359-e041-4717-a9ba-82d487dda940', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:30:08 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-895a26d5-a00e-44cb-be0b-99d9e39c1b16 req-f55c0ba1-45a4-4811-ac50-7cdd18b7ad28 tempest-TestStampPattern-684927933 None] attachment_update completed successfully.
Sep 09 13:30:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-292c3469-11d3-4cd0-92e1-a4311ebab266 req-038152cb-9726-457a-8c58-a50c946d25b9 tempest-TestStampPattern-684927933 None] Terminate volume connection completed successfully.
Sep 09 13:30:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-292c3469-11d3-4cd0-92e1-a4311ebab266 req-038152cb-9726-457a-8c58-a50c946d25b9 tempest-TestStampPattern-684927933 None] Deleting attachment 84ad7359-e041-4717-a9ba-82d487dda940. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Creating offline snapshot 813dd949-af84-4b5d-ab65-11a7769c2ee0 of volume 4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eda398-ca32-4daf-ab9b-37ef4cea8b80]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:13 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:30:13 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:13 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:13 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 1G
Sep 09 13:30:13 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:14 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 1G" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4047f94d-a58c-45e8-a89f-118bf83a6501 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:14 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4047f94d-a58c-45e8-a89f-118bf83a6501 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:30:14 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:14 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4047f94d-a58c-45e8-a89f-118bf83a6501 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:14 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 is being set with open permissions: ugo+rw
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:14 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:30:14 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:14 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.245s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:14 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info
Sep 09 13:30:14 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:14 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:14 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info is being set with open permissions: ugo+rw
Sep 09 13:30:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:14 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info
Sep 09 13:30:14 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:15 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.info" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:15 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-492700d6-b4b4-4bb2-b740-ccf1fd0d5788 tempest-TestStampPattern-684927933 None] Create snapshot completed successfully
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Flow 'volume_create_manager' (ef6b310e-47f3-461c-9920-552c063b777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b7b16-c1da-46bd-9a54-3d903839a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b7b16-c1da-46bd-9a54-3d903839a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1461809493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efc4756-517c-4cb0-bc8e-775ef2c98b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08141d5b3332489ca7bfaa69594b890e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=813dd949-af84-4b5d-ab65-11a7769c2ee0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:30:22Z,use_quota=True,user_id='90ef0215ecc6447d900489e1402b8583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b8c24c-ad75-4ff5-b340-97d64d9c0874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b8c24c-ad75-4ff5-b340-97d64d9c0874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914b570-ff28-4e1c-95fa-556dc4810d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3914b570-ff28-4e1c-95fa-556dc4810d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6efc4756-517c-4cb0-bc8e-775ef2c98b31', 'volume_name': 'volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31', 'volume_size': 1, 'snapshot_id': '813dd949-af84-4b5d-ab65-11a7769c2ee0'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afe94e6-4a35-42cc-956e-5d2158727cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afe94e6-4a35-42cc-956e-5d2158727cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea6f84-c0bb-4ec1-abdd-606ae7ac7d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Volume 6efc4756-517c-4cb0-bc8e-775ef2c98b31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31', 'volume_size': 1, 'snapshot_id': '813dd949-af84-4b5d-ab65-11a7769c2ee0'}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0-6efc4756-517c-4cb0-bc8e-775ef2c98b31" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0-6efc4756-517c-4cb0-bc8e-775ef2c98b31" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Creating volume 6efc4756-517c-4cb0-bc8e-775ef2c98b31 from snapshot 813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] snapshot: 813dd949-af84-4b5d-ab65-11a7769c2ee0, volume: 6efc4756-517c-4cb0-bc8e-775ef2c98b31,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ff79ff-92ec-47ca-a118-aeb79128132b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:22 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:30:22 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:22 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4047f94d-a58c-45e8-a89f-118bf83a6501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15ac9b-f80f-41d3-8f99-0b4bfe53884b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:22 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:30:22 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:22 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:30:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:22 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31
Sep 09 13:30:22 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:25 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:30:25 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:26 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 1.075s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:26 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:30:26 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:30:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:30:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:30:28 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31" returned: 0 in 5.740s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:28 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:30:28 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Converted 1024.00 MB image at 178.38 MB/s
Sep 09 13:30:28 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 is being set with open permissions: ugo+rw
Sep 09 13:30:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:30:28 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31
Sep 09 13:30:28 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:30:28 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 09 13:30:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:30:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" released by "_copy_volume_from_snapshot" :: held 6.888s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0-6efc4756-517c-4cb0-bc8e-775ef2c98b31" released by "_create_volume_from_snapshot" :: held 6.954s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.970s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea6f84-c0bb-4ec1-abdd-606ae7ac7d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31', 'volume_size': 1, 'snapshot_id': '813dd949-af84-4b5d-ab65-11a7769c2ee0'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef2134-c1d7-4f1c-9e5a-2b226554f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:30:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Volume volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 (6efc4756-517c-4cb0-bc8e-775ef2c98b31): created successfully
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef2134-c1d7-4f1c-9e5a-2b226554f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:30:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Flow 'volume_create_manager' (ef6b310e-47f3-461c-9920-552c063b777e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:30:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3c091ad0-43d3-462f-b39c-0389a1495370 tempest-TestStampPattern-684927933 None] Created volume successfully.
Sep 09 13:30:39 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:30:39 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:31:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7bea7737-88a8-4bd9-b30d-430c77b48583 req-e6c66f3f-d45e-4f66-a86e-9ffa3fe454f1 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7bea7737-88a8-4bd9-b30d-430c77b48583 req-e6c66f3f-d45e-4f66-a86e-9ffa3fe454f1 tempest-TestStampPattern-684927933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [req-7bea7737-88a8-4bd9-b30d-430c77b48583 req-e6c66f3f-d45e-4f66-a86e-9ffa3fe454f1 tempest-TestStampPattern-684927933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-7bea7737-88a8-4bd9-b30d-430c77b48583 req-e6c66f3f-d45e-4f66-a86e-9ffa3fe454f1 tempest-TestStampPattern-684927933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3', 'name': 'volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e961816-8c3d-4f0c-b37e-6841e03b9dfc', 'enforce_multipath': True} {{(pid=87606) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 09 13:31:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-7bea7737-88a8-4bd9-b30d-430c77b48583 req-e6c66f3f-d45e-4f66-a86e-9ffa3fe454f1 tempest-TestStampPattern-684927933 None] attachment_update completed successfully.
Sep 09 13:31:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [req-9f1e800f-adbd-4ce3-b36e-48cd4b358f86 req-ae1ace8c-5202-45da-9f93-748dfa33b859 tempest-TestStampPattern-684927933 None] Terminate volume connection completed successfully.
Sep 09 13:31:14 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [req-9f1e800f-adbd-4ce3-b36e-48cd4b358f86 req-ae1ace8c-5202-45da-9f93-748dfa33b859 tempest-TestStampPattern-684927933 None] Deleting attachment 9e961816-8c3d-4f0c-b37e-6841e03b9dfc. {{(pid=87606) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-6efc4756-517c-4cb0-bc8e-775ef2c98b31-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "cinder-6efc4756-517c-4cb0-bc8e-775ef2c98b31-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e0da5-ffdf-4740-b085-fd6462cc3e9c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:18 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31
Sep 09 13:31:18 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:18 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:18 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31
Sep 09 13:31:18 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:18 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6efc4756-517c-4cb0-bc8e-775ef2c98b31" returned: 0 in 0.244s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-6efc4756-517c-4cb0-bc8e-775ef2c98b31" released by "delete_volume" :: held 0.640s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:18 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Created reservations ['7f15a1bc-5461-410f-a69a-e0f891e54008', 'd3e88f9a-65d3-4de1-94ff-273825fa2559', '4a71237d-aa70-4183-9701-5a5c647d6fec', 'ac9634f8-9392-40d1-96c5-90141baf3522'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:19 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:31:19 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:19 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.241s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:31:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Deleted volume successfully.
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-007d6863-1672-4940-90c8-fdb8f64bdcd4 tempest-TestStampPattern-684927933 None] Lock "cinder-6efc4756-517c-4cb0-bc8e-775ef2c98b31-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-813dd949-af84-4b5d-ab65-11a7769c2ee0-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-813dd949-af84-4b5d-ab65-11a7769c2ee0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Deleting offline snapshot 813dd949-af84-4b5d-ab65-11a7769c2ee0 of volume 4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] snapshot_file for this snap is: volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1d5ea-5080-4087-b5c7-d4c3345f2cb2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:19 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:31:19 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:20 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4047f94d-a58c-45e8-a89f-118bf83a6501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e7ee6-7167-4912-ab65-98c3a629d0dd]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:20 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:31:20 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:20 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.513s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:20 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:31:20 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:20 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.336s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:20 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0
Sep 09 13:31:20 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:21 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501.813dd949-af84-4b5d-ab65-11a7769c2ee0" returned: 0 in 0.241s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-813dd949-af84-4b5d-ab65-11a7769c2ee0" released by "_delete_snapshot" :: held 1.530s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" released by "delete_snapshot" :: held 1.553s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:21 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Created reservations ['f9415fd6-6fcc-45ad-ae0b-2f177a717efd', '634f26df-972b-4ea5-b2b0-c07a20a1acf4', '5f2f8b40-e986-4317-81aa-a992ebd84b21', 'a475db30-67a0-4b5c-b6fe-2e2cb816f7d2'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:31:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Delete snapshot completed successfully.
Sep 09 13:31:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23a769b2-28cf-4312-afe4-3e7440f0eac8 tempest-TestStampPattern-684927933 None] Lock "cinder-813dd949-af84-4b5d-ab65-11a7769c2ee0-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-4047f94d-a58c-45e8-a89f-118bf83a6501-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "cinder-4047f94d-a58c-45e8-a89f-118bf83a6501-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Acquiring lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102c265-2a7e-48bc-887a-2a96ff918b88]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:25 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:31:25 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:25 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:31:25 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:25 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.239s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:31:25 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:25 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501
Sep 09 13:31:25 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:25 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4047f94d-a58c-45e8-a89f-118bf83a6501" returned: 0 in 0.245s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "cinder-quobyte-4047f94d-a58c-45e8-a89f-118bf83a6501" released by "delete_volume" :: held 0.695s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Created reservations ['95e62733-02fd-4b41-bd89-dfd906c92dcf', 'adfa4b55-caea-4be5-9f34-2430a955a364', '6cf1eb0f-82f1-410c-9b4f-bf86172acbb2', '231fb489-aea6-4341-b72e-9984729f3395'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:26 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:31:26 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:26 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.259s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:31:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Deleted volume successfully.
Sep 09 13:31:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3d4b18ff-ee75-440f-86b2-58f07795fecf tempest-TestStampPattern-684927933 None] Lock "cinder-4047f94d-a58c-45e8-a89f-118bf83a6501-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:36 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:31:36 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Flow 'volume_create_manager' (16073730-61d3-432f-acc1-737eee2c1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066549b-b180-472d-9511-c8d3111fac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066549b-b180-472d-9511-c8d3111fac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0288cd84-fa38-4391-9549-6820ecb78542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b992cfd645d698856fc91cc84052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:41Z,use_quota=True,user_id='686a821da35549098bb2f5f4416b50b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b6e0bae-0ed9-4be4-9d03-8b42940237f1),volume_type_id=4b6e0bae-0ed9-4be4-9d03-8b42940237f1)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fbd2d7-0c3a-42b1-a945-6d8fb7c7c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fbd2d7-0c3a-42b1-a945-6d8fb7c7c63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081790ed-9ff1-4b15-8a38-78649b3df328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081790ed-9ff1-4b15-8a38-78649b3df328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0288cd84-fa38-4391-9549-6820ecb78542', 'volume_name': 'volume-0288cd84-fa38-4391-9549-6820ecb78542', 'volume_size': 1, 'image_id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1edc4b9ad0384499280fe6a8acb097fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e86b992cfd645d698856fc91cc84052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c102da9d1e5e47bde5dbfaa0f2c2e83806c34521effd72992be0ae15694689c32ff83e1668be3ec0cbdcbbc2fdb8e99a1b8a79f8b712cc05466a40c5adfcb9d9', 'id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'created_at': datetime.datetime(2026, 9, 9, 11, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 31, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/084ef87d-5c1d-4456-9a56-6e7f481e0600/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8eb40>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7600ed16-4191-4308-bffd-4240d6aca864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7600ed16-4191-4308-bffd-4240d6aca864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b5475-8c70-46de-80d7-20f29c3e4ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Volume 0288cd84-fa38-4391-9549-6820ecb78542: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0288cd84-fa38-4391-9549-6820ecb78542', 'volume_size': 1, 'image_id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1edc4b9ad0384499280fe6a8acb097fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e86b992cfd645d698856fc91cc84052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c102da9d1e5e47bde5dbfaa0f2c2e83806c34521effd72992be0ae15694689c32ff83e1668be3ec0cbdcbbc2fdb8e99a1b8a79f8b712cc05466a40c5adfcb9d9', 'id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'created_at': datetime.datetime(2026, 9, 9, 11, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 31, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/084ef87d-5c1d-4456-9a56-6e7f481e0600/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8eb40>}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Trying to clone 0288cd84-fa38-4391-9549-6820ecb78542 from image 084ef87d-5c1d-4456-9a56-6e7f481e0600 at location (None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:31:41 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d405bb-906e-4ab4-9686-308dbe8c4cd6]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:41 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:41 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:41 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:42 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:42 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:42 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Temporary image 084ef87d-5c1d-4456-9a56-6e7f481e0600 is fetched for user 686a821da35549098bb2f5f4416b50b2. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae23a1c-ead5-409c-8035-acbb06fd543c]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:42 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:42 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:42 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:42 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:42 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:42 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0288cd84-fa38-4391-9549-6820ecb78542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b992cfd645d698856fc91cc84052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:41Z,use_quota=True,user_id='686a821da35549098bb2f5f4416b50b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b6e0bae-0ed9-4be4-9d03-8b42940237f1),volume_type_id=4b6e0bae-0ed9-4be4-9d03-8b42940237f1)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Creating volume 0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:42 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:42 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1073741824
Sep 09 13:31:42 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:43 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1073741824" returned: 0 in 0.398s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:43 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542
Sep 09 13:31:43 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:43 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Attempting download of 084ef87d-5c1d-4456-9a56-6e7f481e0600 ((None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}])) to volume 0288cd84-fa38-4391-9549-6820ecb78542. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee31dd-b916-43cd-974c-3a1b3f821697]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:43 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0
Sep 09 13:31:43 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:44 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0" returned: 0 in 0.328s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:44 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0
Sep 09 13:31:44 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:44 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0" returned: 1 in 0.323s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_084ef87d-5c1d-4456-9a56-6e7f481e0600_bd6be7s0' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[db143ac2-b94d-47ef-aad2-0085ce06b18c]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:44 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:44 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:44 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:44 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD
Sep 09 13:31:44 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:44 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] 084ef87d-5c1d-4456-9a56-6e7f481e0600 was raw, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:31:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:45 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542
Sep 09 13:31:45 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:45 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542" returned: 0 in 0.436s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_084ef87d-5c1d-4456-9a56-6e7f481e0600_e2xv_iy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:31:45 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:45 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1G
Sep 09 13:31:45 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:45 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 1G" returned: 0 in 0.300s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Downloaded image 084ef87d-5c1d-4456-9a56-6e7f481e0600 ((None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}])) to volume 0288cd84-fa38-4391-9549-6820ecb78542 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Temporary image 084ef87d-5c1d-4456-9a56-6e7f481e0600 for user 686a821da35549098bb2f5f4416b50b2 is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Marking volume 0288cd84-fa38-4391-9549-6820ecb78542 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Copying metadata from image 084ef87d-5c1d-4456-9a56-6e7f481e0600 to 0288cd84-fa38-4391-9549-6820ecb78542. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Creating volume glance metadata for volume 0288cd84-fa38-4391-9549-6820ecb78542 backed by image 084ef87d-5c1d-4456-9a56-6e7f481e0600 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1edc4b9ad0384499280fe6a8acb097fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b5475-8c70-46de-80d7-20f29c3e4ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0288cd84-fa38-4391-9549-6820ecb78542', 'volume_size': 1, 'image_id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/084ef87d-5c1d-4456-9a56-6e7f481e0600', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1edc4b9ad0384499280fe6a8acb097fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e86b992cfd645d698856fc91cc84052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c102da9d1e5e47bde5dbfaa0f2c2e83806c34521effd72992be0ae15694689c32ff83e1668be3ec0cbdcbbc2fdb8e99a1b8a79f8b712cc05466a40c5adfcb9d9', 'id': '084ef87d-5c1d-4456-9a56-6e7f481e0600', 'created_at': datetime.datetime(2026, 9, 9, 11, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 31, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/084ef87d-5c1d-4456-9a56-6e7f481e0600/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53bc8eb40>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ba5b58-48d5-438c-9a47-ce33dd93d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:45 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Volume volume-0288cd84-fa38-4391-9549-6820ecb78542 (0288cd84-fa38-4391-9549-6820ecb78542): created successfully
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ba5b58-48d5-438c-9a47-ce33dd93d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:45 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Flow 'volume_create_manager' (16073730-61d3-432f-acc1-737eee2c1d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f3445c10-7975-4188-8f95-2a69e20e1428 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Created volume successfully.
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Acquiring lock "cinder-0288cd84-fa38-4391-9549-6820ecb78542-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "cinder-0288cd84-fa38-4391-9549-6820ecb78542-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Acquiring lock "cinder-quobyte-0288cd84-fa38-4391-9549-6820ecb78542" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "cinder-quobyte-0288cd84-fa38-4391-9549-6820ecb78542" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84afc0f-c517-466e-a669-23cd9ed6ebbb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:46 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542
Sep 09 13:31:46 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:47 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:47 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542
Sep 09 13:31:47 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:47 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0288cd84-fa38-4391-9549-6820ecb78542" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "cinder-quobyte-0288cd84-fa38-4391-9549-6820ecb78542" released by "delete_volume" :: held 0.629s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:47 devstack cinder-volume[87606]: WARNING cinder.quota [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:31:47 devstack cinder-volume[87606]: WARNING cinder.quota [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Created reservations ['9de92f11-117e-4a7c-96c7-805a188a8191', '6ec8d416-9727-47f4-b903-1a5cd12294f6', '854d7a5b-7b99-4ab8-8c23-26ce2e302623', '41a69ea7-18e9-4450-90c5-47601c2eb9a1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:47 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:31:47 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:47 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:31:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Deleted volume successfully.
Sep 09 13:31:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1fbf54b-56a1-4e67-97b2-4b93475d85d6 tempest-VolumeAndVolumeTypeFromImageTest-2064978222 None] Lock "cinder-0288cd84-fa38-4391-9549-6820ecb78542-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (89f3c6b4-c00f-464f-b504-e371898f510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7171419a-e514-4362-b3d4-85ca8a60136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7171419a-e514-4362-b3d4-85ca8a60136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837708299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b450b0b-8fcb-4c85-9871-5b75ace0317b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:52Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547546f6-d44b-4116-ab21-610a16994e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547546f6-d44b-4116-ab21-610a16994e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461a4aab-f788-42a2-b9ce-e50d29b19716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461a4aab-f788-42a2-b9ce-e50d29b19716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b450b0b-8fcb-4c85-9871-5b75ace0317b', 'volume_name': 'volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0361ee82-7165-46d8-9002-c3b824f05799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0361ee82-7165-46d8-9002-c3b824f05799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606856f1-48cd-458b-95cd-386586e49589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:51 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume 5b450b0b-8fcb-4c85-9871-5b75ace0317b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b', 'volume_size': 1}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837708299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b450b0b-8fcb-4c85-9871-5b75ace0317b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:52Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume 5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:51 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:51 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b 1073741824
Sep 09 13:31:51 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:52 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b 1073741824" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:52 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b
Sep 09 13:31:52 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:52 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b" returned: 0 in 0.244s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606856f1-48cd-458b-95cd-386586e49589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cdaea-358e-453c-93ae-d31c617368ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:52 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b (5b450b0b-8fcb-4c85-9871-5b75ace0317b): created successfully
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cdaea-358e-453c-93ae-d31c617368ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (89f3c6b4-c00f-464f-b504-e371898f510d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-89e9d689-477f-4d84-9aa3-876512d53340 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating offline snapshot a70a1d40-533d-4a34-acac-f683e076e9b3 of volume 5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[061430e4-9a44-4312-8365-b97018859bf2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:31:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:53 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b
Sep 09 13:31:53 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:53 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b" returned: 0 in 0.348s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:53 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 1G
Sep 09 13:31:53 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:53 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 1G" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:53 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3
Sep 09 13:31:53 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:53 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3" returned: 0 in 0.292s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:53 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 is being set with open permissions: ugo+rw
Sep 09 13:31:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:53 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3
Sep 09 13:31:53 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:54 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:54 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info
Sep 09 13:31:54 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:54 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info" returned: 0 in 0.250s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:54 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info is being set with open permissions: ugo+rw
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:54 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info
Sep 09 13:31:54 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:54 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.info" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-05c89f85-5568-4f3e-b2c9-732c268566ce tempest-CreateVolumesFromSnapshotTest-1770206024 None] Create snapshot completed successfully
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (621a9fee-a480-4321-be7e-70a51c77a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b0042b-29bb-445b-a03b-ed05cae1f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b0042b-29bb-445b-a03b-ed05cae1f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466720881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3857e965-5203-4f7c-a4e3-0ce763f5256a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:55Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3038a9e-cc21-4020-8e2b-9b8f9bfeb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3038a9e-cc21-4020-8e2b-9b8f9bfeb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25defab4-657f-4072-b6dd-ea20f956da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25defab4-657f-4072-b6dd-ea20f956da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3857e965-5203-4f7c-a4e3-0ce763f5256a', 'volume_name': 'volume-3857e965-5203-4f7c-a4e3-0ce763f5256a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08990ca-9ae9-4521-aba2-2e390de9d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08990ca-9ae9-4521-aba2-2e390de9d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf893e1-beb6-4a1c-954a-5a12d8a77ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume 3857e965-5203-4f7c-a4e3-0ce763f5256a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3857e965-5203-4f7c-a4e3-0ce763f5256a', 'volume_size': 1}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466720881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3857e965-5203-4f7c-a4e3-0ce763f5256a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:55Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume 3857e965-5203-4f7c-a4e3-0ce763f5256a {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:55 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:55 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a 1073741824
Sep 09 13:31:55 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (fe390ca7-501e-4da6-baed-8f96c9e03446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b2d231-0b5a-4de6-87db-21fe117b340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b2d231-0b5a-4de6-87db-21fe117b340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449676624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa8caa4-8383-4e73-882d-56123012a8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:56Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886b782-c2a6-4098-a934-3a493fb9590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886b782-c2a6-4098-a934-3a493fb9590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c516cef9-6cb5-4466-894b-d9cfcec4b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c516cef9-6cb5-4466-894b-d9cfcec4b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa8caa4-8383-4e73-882d-56123012a8a3', 'volume_name': 'volume-ffa8caa4-8383-4e73-882d-56123012a8a3', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc996c1-be67-4f67-8343-f5872bcaeabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc996c1-be67-4f67-8343-f5872bcaeabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c55f1f-6be2-4863-a078-d4f5615b1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume ffa8caa4-8383-4e73-882d-56123012a8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa8caa4-8383-4e73-882d-56123012a8a3', 'volume_size': 1}
Sep 09 13:31:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:56 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a 1073741824" returned: 0 in 0.488s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:56 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a
Sep 09 13:31:56 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (6baffee3-d330-47e5-9f92-3540fbf6b90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8111a7-7a80-4eea-9996-5a4acb51d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8111a7-7a80-4eea-9996-5a4acb51d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38344939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecac323-72a9-476a-b26a-912d96a497b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:56Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b171911b-45d6-4875-aed1-ecf6a3655541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b171911b-45d6-4875-aed1-ecf6a3655541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f115bf90-a9bc-4e3c-bf5e-d6bf338ff110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f115bf90-a9bc-4e3c-bf5e-d6bf338ff110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecac323-72a9-476a-b26a-912d96a497b1', 'volume_name': 'volume-9ecac323-72a9-476a-b26a-912d96a497b1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55a901-2ba2-4a58-b012-28c0fb829631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55a901-2ba2-4a58-b012-28c0fb829631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9920f3b-a2e8-47b8-bf42-b0660bb9150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume 9ecac323-72a9-476a-b26a-912d96a497b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecac323-72a9-476a-b26a-912d96a497b1', 'volume_size': 1}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:56 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a" returned: 0 in 0.294s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449676624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa8caa4-8383-4e73-882d-56123012a8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:56Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume ffa8caa4-8383-4e73-882d-56123012a8a3 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:56 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:56 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 1073741824
Sep 09 13:31:56 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf893e1-beb6-4a1c-954a-5a12d8a77ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3857e965-5203-4f7c-a4e3-0ce763f5256a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3d3448-1d17-44a2-a9c6-31614a1c5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-3857e965-5203-4f7c-a4e3-0ce763f5256a (3857e965-5203-4f7c-a4e3-0ce763f5256a): created successfully
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3d3448-1d17-44a2-a9c6-31614a1c5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (621a9fee-a480-4321-be7e-70a51c77a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:56 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-75eebba1-df65-4dce-997e-5db495806dd2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (8aa8aae1-710f-4bbf-9323-10889c9cee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab403fe2-4e0b-4523-a562-ce6254606e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab403fe2-4e0b-4523-a562-ce6254606e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583527208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb55628-fdb1-4ae5-a6b1-199774b79e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:57Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bafc66-8f65-45c4-9344-497a6901986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bafc66-8f65-45c4-9344-497a6901986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d49c7c-04c9-4625-a869-203636aac3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d49c7c-04c9-4625-a869-203636aac3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb55628-fdb1-4ae5-a6b1-199774b79e1b', 'volume_name': 'volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db170da-8146-44b7-9183-5c322ce7d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db170da-8146-44b7-9183-5c322ce7d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32926c40-3db3-4302-a3ee-4d14a064df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:56 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume 1fb55628-fdb1-4ae5-a6b1-199774b79e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b', 'volume_size': 1}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:56 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 1073741824" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:56 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3
Sep 09 13:31:56 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:56 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (8217d133-e74f-4e59-9680-3d7df396c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0d3e91-d3a4-440f-9f16-9b64e8dd1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0d3e91-d3a4-440f-9f16-9b64e8dd1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101005097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c86c721-c630-4ac8-a174-c179cf4b9299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:57Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef509d2-262c-45c2-9d9b-ee08f95538b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef509d2-262c-45c2-9d9b-ee08f95538b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce7171-097f-4986-bb03-539467135473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce7171-097f-4986-bb03-539467135473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c86c721-c630-4ac8-a174-c179cf4b9299', 'volume_name': 'volume-0c86c721-c630-4ac8-a174-c179cf4b9299', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0249c4-7d43-4509-9932-d729060dadeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0249c4-7d43-4509-9932-d729060dadeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f68a11-769b-4959-b72a-a5589b2a63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume 0c86c721-c630-4ac8-a174-c179cf4b9299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c86c721-c630-4ac8-a174-c179cf4b9299', 'volume_size': 1}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:57 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3" returned: 0 in 0.255s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38344939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecac323-72a9-476a-b26a-912d96a497b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:56Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume 9ecac323-72a9-476a-b26a-912d96a497b1 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c55f1f-6be2-4863-a078-d4f5615b1b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa8caa4-8383-4e73-882d-56123012a8a3', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 1073741824
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf702376-c9c4-4dc5-85ac-8f44d2246c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-ffa8caa4-8383-4e73-882d-56123012a8a3 (ffa8caa4-8383-4e73-882d-56123012a8a3): created successfully
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf702376-c9c4-4dc5-85ac-8f44d2246c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (fe390ca7-501e-4da6-baed-8f96c9e03446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f72723e6-07ff-4b9d-86c4-178c1ca6dbf2 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:31:57 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 1073741824" returned: 0 in 0.395s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:57 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1
Sep 09 13:31:57 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:57 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583527208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb55628-fdb1-4ae5-a6b1-199774b79e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:57Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume 1fb55628-fdb1-4ae5-a6b1-199774b79e1b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9920f3b-a2e8-47b8-bf42-b0660bb9150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecac323-72a9-476a-b26a-912d96a497b1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b 1073741824
Sep 09 13:31:57 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d621cd0-8508-4741-aa81-f55f31549279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-9ecac323-72a9-476a-b26a-912d96a497b1 (9ecac323-72a9-476a-b26a-912d96a497b1): created successfully
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d621cd0-8508-4741-aa81-f55f31549279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:57 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (6baffee3-d330-47e5-9f92-3540fbf6b90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-71103a39-c470-4ab1-aa43-905d817ab6c7 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:31:58 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b 1073741824" returned: 0 in 0.416s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:58 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b
Sep 09 13:31:58 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:58 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" returned: 0 in 0.238s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101005097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c86c721-c630-4ac8-a174-c179cf4b9299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a336f463beff4162b38bffc9d5e914cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:31:57Z,use_quota=True,user_id='8a87e1d264b242598c57882420fb8923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Creating volume 0c86c721-c630-4ac8-a174-c179cf4b9299 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:31:58 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32926c40-3db3-4302-a3ee-4d14a064df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:58 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 1073741824
Sep 09 13:31:58 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b796c6c-0cd3-4820-90c5-849e9efdc881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:58 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b (1fb55628-fdb1-4ae5-a6b1-199774b79e1b): created successfully
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b796c6c-0cd3-4820-90c5-849e9efdc881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (8aa8aae1-710f-4bbf-9323-10889c9cee75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-355771aa-7af4-4806-8be5-f75a62756d13 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:31:58 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 1073741824" returned: 0 in 0.413s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:31:59 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299
Sep 09 13:31:59 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:31:59 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f68a11-769b-4959-b72a-a5589b2a63b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c86c721-c630-4ac8-a174-c179cf4b9299', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ab368d-9c5d-40ab-b6b2-7f7051423639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:31:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Volume volume-0c86c721-c630-4ac8-a174-c179cf4b9299 (0c86c721-c630-4ac8-a174-c179cf4b9299): created successfully
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ab368d-9c5d-40ab-b6b2-7f7051423639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:31:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Flow 'volume_create_manager' (8217d133-e74f-4e59-9680-3d7df396c78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:31:59 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-bfd4d440-8de2-4627-86e8-b5f23eb2911a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created volume successfully.
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-0c86c721-c630-4ac8-a174-c179cf4b9299-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-0c86c721-c630-4ac8-a174-c179cf4b9299-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-0c86c721-c630-4ac8-a174-c179cf4b9299" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-0c86c721-c630-4ac8-a174-c179cf4b9299" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[38387926-3943-4db1-92fe-03e16bb642d8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:00 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299
Sep 09 13:32:00 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:00 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299" returned: 0 in 0.366s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:00 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299
Sep 09 13:32:00 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:01 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0c86c721-c630-4ac8-a174-c179cf4b9299" returned: 0 in 0.245s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-0c86c721-c630-4ac8-a174-c179cf4b9299" released by "delete_volume" :: held 0.648s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['93c9f56f-c187-499d-aeaf-8e7291633023', 'a0f889f6-cc76-45b5-9f5d-8a9f6e3a3bcf', '2b6fda43-0cfd-4d6d-bbca-6b31867658d6', 'c07e58dc-13ee-4afa-9c46-d216032eda4d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:01 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:01 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:01 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e3604fce-d8c2-40b3-a7bd-3ed7d6c0114c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-0c86c721-c630-4ac8-a174-c179cf4b9299-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-1fb55628-fdb1-4ae5-a6b1-199774b79e1b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-1fb55628-fdb1-4ae5-a6b1-199774b79e1b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56db76-901d-422c-835a-0be05efe58dc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:01 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b
Sep 09 13:32:01 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:01 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:02 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b
Sep 09 13:32:02 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:02 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-1fb55628-fdb1-4ae5-a6b1-199774b79e1b" released by "delete_volume" :: held 0.651s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['1c2cc0bf-6512-437b-b1cc-28ce063ffc28', '5a82a673-b6f1-42f3-a2f6-8c8ac96ead3a', 'f5591603-1875-4e3a-8aa9-7a4ed662dab8', 'ce928eb2-f44d-4738-bee5-c768f11aa133'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:02 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:02 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:02 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.235s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1c960d38-31ab-4056-9601-6a0c4e61056a tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-1fb55628-fdb1-4ae5-a6b1-199774b79e1b-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-9ecac323-72a9-476a-b26a-912d96a497b1-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-9ecac323-72a9-476a-b26a-912d96a497b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-9ecac323-72a9-476a-b26a-912d96a497b1" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-9ecac323-72a9-476a-b26a-912d96a497b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cbe645-7324-4ca3-8956-c0148aac9a18]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:02 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1
Sep 09 13:32:02 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:03 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1" returned: 0 in 0.356s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:03 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1
Sep 09 13:32:03 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:03 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9ecac323-72a9-476a-b26a-912d96a497b1" returned: 0 in 0.245s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-9ecac323-72a9-476a-b26a-912d96a497b1" released by "delete_volume" :: held 0.639s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['39c45ba7-9dd2-44b3-9550-6b2ec374c8c6', '960ce6ce-cf8c-4234-a449-57a97072bc69', '5b087bc8-edd0-4abe-b4b1-73d71384e17e', '7c41e40e-78f4-4039-8599-85f8527f3af9'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:03 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:03 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:03 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.236s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-63f41b34-6dda-4860-8ee7-ea552d4f280c tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-9ecac323-72a9-476a-b26a-912d96a497b1-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-ffa8caa4-8383-4e73-882d-56123012a8a3-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-ffa8caa4-8383-4e73-882d-56123012a8a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-ffa8caa4-8383-4e73-882d-56123012a8a3" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-ffa8caa4-8383-4e73-882d-56123012a8a3" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db51e0-09c9-4a9c-85c1-db6fb45768d8]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:04 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3
Sep 09 13:32:04 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:04 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:04 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3
Sep 09 13:32:04 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:04 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ffa8caa4-8383-4e73-882d-56123012a8a3" returned: 0 in 0.240s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-ffa8caa4-8383-4e73-882d-56123012a8a3" released by "delete_volume" :: held 0.633s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['f762126f-7255-425a-842e-f1091c141511', '3ded3406-6b11-42e4-a5b5-942f89f3f689', '02a87bec-b7a4-4f14-b765-ff234d24952f', '0fd2ecd1-1bc6-4cd9-83d4-81008dbf5d61'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:04 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:04 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:04 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-8b2c7371-b050-4fd5-93f2-2d15e33988fb tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-ffa8caa4-8383-4e73-882d-56123012a8a3-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-3857e965-5203-4f7c-a4e3-0ce763f5256a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-3857e965-5203-4f7c-a4e3-0ce763f5256a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-3857e965-5203-4f7c-a4e3-0ce763f5256a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-3857e965-5203-4f7c-a4e3-0ce763f5256a" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7fa2d-eea0-4711-9ce4-d4cc29eb2e0a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:05 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a
Sep 09 13:32:05 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:05 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a" returned: 0 in 0.359s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:05 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a
Sep 09 13:32:05 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:05 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3857e965-5203-4f7c-a4e3-0ce763f5256a" returned: 0 in 0.244s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-3857e965-5203-4f7c-a4e3-0ce763f5256a" released by "delete_volume" :: held 0.648s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['e1de00d4-0e71-4d63-9609-22d03bfe45cc', '40245098-9a30-4c14-8c6c-f4f9f20106a8', 'eb2af9bd-b977-4eb0-90de-cc5f6b6db874', '1d8d1932-96d4-429f-84d5-294c77ff772e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:05 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:05 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:06 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0e0fe4cf-1fff-428d-a1f7-1a20cedf99be tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-3857e965-5203-4f7c-a4e3-0ce763f5256a-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-a70a1d40-533d-4a34-acac-f683e076e9b3-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-a70a1d40-533d-4a34-acac-f683e076e9b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-a70a1d40-533d-4a34-acac-f683e076e9b3" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-a70a1d40-533d-4a34-acac-f683e076e9b3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleting offline snapshot a70a1d40-533d-4a34-acac-f683e076e9b3 of volume 5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] snapshot_file for this snap is: volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0be4444-cfe8-4137-9d60-639da10faeac]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:06 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3
Sep 09 13:32:06 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:06 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d8b0e-d335-462d-9508-aa2de649749f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:06 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b
Sep 09 13:32:06 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:06 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:07 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3
Sep 09 13:32:07 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:07 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3" returned: 0 in 0.327s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:07 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3
Sep 09 13:32:07 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:07 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b.a70a1d40-533d-4a34-acac-f683e076e9b3" returned: 0 in 0.255s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-a70a1d40-533d-4a34-acac-f683e076e9b3" released by "_delete_snapshot" :: held 1.396s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" released by "delete_snapshot" :: held 1.425s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['dcb50cf5-8197-4168-b52d-e6f4a5c83a31', 'baf2a665-24d4-4479-9537-7c6faa23f67c', 'd93bbd66-0442-4445-8c12-5be5dd42a909', '12931c3e-850d-4091-9ca6-8469b941a6bb'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Delete snapshot completed successfully.
Sep 09 13:32:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-4ffd8211-30e3-4e39-bae1-9eca335b3d09 tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-a70a1d40-533d-4a34-acac-f683e076e9b3-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-5b450b0b-8fcb-4c85-9871-5b75ace0317b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-5b450b0b-8fcb-4c85-9871-5b75ace0317b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c739b-14d2-4ff4-a872-4127b27c1ea0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:08 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b
Sep 09 13:32:08 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:08 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:08 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b
Sep 09 13:32:08 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:09 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-5b450b0b-8fcb-4c85-9871-5b75ace0317b" returned: 0 in 0.241s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-quobyte-5b450b0b-8fcb-4c85-9871-5b75ace0317b" released by "delete_volume" :: held 0.647s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Created reservations ['94a405c7-2547-4879-8b9d-dc96c3eff070', 'd3f9b7cc-3744-446e-953b-c47fdfb7379b', 'add48e06-c186-4376-9b29-46d81f60989d', '2e8810d6-d2b0-4bda-a27a-1402e67e41c4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:09 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:09 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:09 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.239s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Deleted volume successfully.
Sep 09 13:32:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9f1da959-c6b9-4bac-a8d5-63b85ad09e0e tempest-CreateVolumesFromSnapshotTest-1770206024 None] Lock "cinder-5b450b0b-8fcb-4c85-9871-5b75ace0317b-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=84,cinder:SELECT=54,cinder:INSERT=31,cinder:DELETE=6 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:32:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=74,cinder:UPDATE=87,cinder:INSERT=19,cinder:DELETE=9 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:32:20 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (f90e0fd4-490e-4609-851a-a6f9a7f6b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1025e5-5d82-46f0-86cb-9b5accb6992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1025e5-5d82-46f0-86cb-9b5accb6992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604353494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8dbd68-efd7-48f7-9326-660aa78ec414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:21Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b3417c-4766-42d6-b307-2a74caa9f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b3417c-4766-42d6-b307-2a74caa9f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1c8a00-1876-4bd5-9cdd-b5005a9246c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1c8a00-1876-4bd5-9cdd-b5005a9246c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8dbd68-efd7-48f7-9326-660aa78ec414', 'volume_name': 'volume-4a8dbd68-efd7-48f7-9326-660aa78ec414', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d240ab76-1f99-4308-ace2-096c84b240e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d240ab76-1f99-4308-ace2-096c84b240e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed33ee7-c622-4d11-814d-8f942c1c9675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Volume 4a8dbd68-efd7-48f7-9326-660aa78ec414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8dbd68-efd7-48f7-9326-660aa78ec414', 'volume_size': 1}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604353494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8dbd68-efd7-48f7-9326-660aa78ec414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:21Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Creating volume 4a8dbd68-efd7-48f7-9326-660aa78ec414 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:21 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:21 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 1073741824
Sep 09 13:32:21 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (ae40c8e1-aee9-491d-97b3-341f0cc6ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c67f807-35eb-4b47-8ad3-6ffb8140b64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c67f807-35eb-4b47-8ad3-6ffb8140b64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944745693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8b38d4-74b9-4f1c-b1ee-979ca85c3759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:21Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc884355-f782-4d87-9407-4b65768c439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc884355-f782-4d87-9407-4b65768c439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf4f5bb-3d80-4e80-84af-8f3828003a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf4f5bb-3d80-4e80-84af-8f3828003a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8b38d4-74b9-4f1c-b1ee-979ca85c3759', 'volume_name': 'volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687dc367-cae9-462b-90ba-fd5115198dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687dc367-cae9-462b-90ba-fd5115198dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc25e87f-4911-42e7-8bfa-e56caa15edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume ef8b38d4-74b9-4f1c-b1ee-979ca85c3759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759', 'volume_size': 1}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:21 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 1073741824" returned: 0 in 0.708s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (bf0accf5-c326-4fc0-b54d-7c0f9595672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88d0d93-8480-4e04-a785-7f2baaf114bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88d0d93-8480-4e04-a785-7f2baaf114bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492683356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9eb4b0-8106-4cbe-9255-f60472f90efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7176b5-7972-471d-9dc2-68fc80ab1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414
Sep 09 13:32:22 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7176b5-7972-471d-9dc2-68fc80ab1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a8b0ca-8bfa-447e-9c0d-d3500c63fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a8b0ca-8bfa-447e-9c0d-d3500c63fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9eb4b0-8106-4cbe-9255-f60472f90efd', 'volume_name': 'volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963cd1df-9a6c-4ed5-8f77-487b70f8df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963cd1df-9a6c-4ed5-8f77-487b70f8df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6e218b-1e6d-4f59-b8cf-345fcb4e5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Volume 0e9eb4b0-8106-4cbe-9255-f60472f90efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd', 'volume_size': 1}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (3e660bfa-140f-4a76-9072-d4dc71cf54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f2fa0e-5ee0-40d2-83e9-619eb684dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f2fa0e-5ee0-40d2-83e9-619eb684dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795713830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488e78fc-6e75-4f5f-80e0-6701c645533c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5db5c8-8ec9-4e55-b5ba-fc4b856584cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5db5c8-8ec9-4e55-b5ba-fc4b856584cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bf1a9-1586-483a-9149-7d3c21f42a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bf1a9-1586-483a-9149-7d3c21f42a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488e78fc-6e75-4f5f-80e0-6701c645533c', 'volume_name': 'volume-488e78fc-6e75-4f5f-80e0-6701c645533c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ff5536-bbbe-403f-bc63-b605808eede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ff5536-bbbe-403f-bc63-b605808eede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e879e7c-2dbd-428b-b612-2ad727085dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume 488e78fc-6e75-4f5f-80e0-6701c645533c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488e78fc-6e75-4f5f-80e0-6701c645533c', 'volume_size': 1}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (e6511621-b58b-4642-8e4f-3ef1d2544c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b00ebd-be03-4c94-b010-1e23365c78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b00ebd-be03-4c94-b010-1e23365c78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437554156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c32c2d-3747-4664-926f-f2dc32b82876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb88b4f-8570-4282-8fbc-340f61a8c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb88b4f-8570-4282-8fbc-340f61a8c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9511d748-117a-4f30-8f3e-7bad217cd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9511d748-117a-4f30-8f3e-7bad217cd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c32c2d-3747-4664-926f-f2dc32b82876', 'volume_name': 'volume-c1c32c2d-3747-4664-926f-f2dc32b82876', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af21b7d-0481-4c07-a04c-6ec1f8ff26a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af21b7d-0481-4c07-a04c-6ec1f8ff26a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7a32e-d8c2-4942-8048-fb0decf663f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Volume c1c32c2d-3747-4664-926f-f2dc32b82876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c32c2d-3747-4664-926f-f2dc32b82876', 'volume_size': 1}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.920s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944745693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8b38d4-74b9-4f1c-b1ee-979ca85c3759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:21Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:22 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 1073741824
Sep 09 13:32:22 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed33ee7-c622-4d11-814d-8f942c1c9675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8dbd68-efd7-48f7-9326-660aa78ec414', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1c3856-ddab-4099-8a8c-a79fb142abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Volume volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 (4a8dbd68-efd7-48f7-9326-660aa78ec414): created successfully
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1c3856-ddab-4099-8a8c-a79fb142abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (f90e0fd4-490e-4609-851a-a6f9a7f6b32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-795a3d6d-f006-4039-96ec-3539c7ac8203 tempest-CreateVolumesFromImageTest-1386221941 None] Created volume successfully.
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (75527080-9f51-4287-bbe6-3b94f3ed9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5bf0e4-d53e-44bb-ad6b-7f1b490e3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5bf0e4-d53e-44bb-ad6b-7f1b490e3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1389790499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9e0365-9759-4dbe-9689-baabe6e40bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:23Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb107f-fdfe-4806-955e-c0774e102bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bb107f-fdfe-4806-955e-c0774e102bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8240dddd-8896-403a-9179-e90d5049bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8240dddd-8896-403a-9179-e90d5049bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9e0365-9759-4dbe-9689-baabe6e40bfa', 'volume_name': 'volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4db693d-04df-4b1a-bf01-651fc1d3f8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4db693d-04df-4b1a-bf01-651fc1d3f8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335a002c-371f-4507-8757-6ce9a0abb920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Volume 0f9e0365-9759-4dbe-9689-baabe6e40bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa', 'volume_size': 1}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (2b7c0747-01d3-47bd-9a0d-c5cd33dbde8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faffaf6-b082-4ccd-8ddc-35d4c6141d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faffaf6-b082-4ccd-8ddc-35d4c6141d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36876021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5eb023-2ded-4881-b1b9-93c56dbf7432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:23Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7272c35b-6c95-4088-866e-93e41706b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7272c35b-6c95-4088-866e-93e41706b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193264c8-d789-4a57-8755-9ca6c9e4a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193264c8-d789-4a57-8755-9ca6c9e4a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5eb023-2ded-4881-b1b9-93c56dbf7432', 'volume_name': 'volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f111ad6b-af67-4657-b833-3e6f6924ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f111ad6b-af67-4657-b833-3e6f6924ebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fe0b53-34da-4df2-aab4-aa31d16bd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Volume 7b5eb023-2ded-4881-b1b9-93c56dbf7432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432', 'volume_size': 1}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 1073741824" returned: 0 in 0.643s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:23 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759
Sep 09 13:32:23 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:23 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492683356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9eb4b0-8106-4cbe-9255-f60472f90efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Creating volume 0e9eb4b0-8106-4cbe-9255-f60472f90efd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:23 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc25e87f-4911-42e7-8bfa-e56caa15edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c33b90-82e8-4194-9646-da4a2cdc38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:23 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd 1073741824
Sep 09 13:32:23 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:23 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 (ef8b38d4-74b9-4f1c-b1ee-979ca85c3759): created successfully
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c33b90-82e8-4194-9646-da4a2cdc38da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (ae40c8e1-aee9-491d-97b3-341f0cc6ba14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:23 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0ae951da-3fed-4a3a-a1be-a0c3278beef2 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:23 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd 1073741824" returned: 0 in 0.482s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:23 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd
Sep 09 13:32:23 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:24 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795713830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488e78fc-6e75-4f5f-80e0-6701c645533c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume 488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:24 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6e218b-1e6d-4f59-b8cf-345fcb4e5b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:24 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c 1073741824
Sep 09 13:32:24 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b253d79d-a270-4021-adb0-a80995226722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:24 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Volume volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd (0e9eb4b0-8106-4cbe-9255-f60472f90efd): created successfully
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b253d79d-a270-4021-adb0-a80995226722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (bf0accf5-c326-4fc0-b54d-7c0f9595672c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4d973cd6-c23b-45b8-9339-9830e7340c05 tempest-CreateVolumesFromImageTest-1386221941 None] Created volume successfully.
Sep 09 13:32:24 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c 1073741824" returned: 0 in 0.478s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:24 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c
Sep 09 13:32:24 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:25 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c" returned: 0 in 0.314s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437554156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c32c2d-3747-4664-926f-f2dc32b82876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:22Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Creating volume c1c32c2d-3747-4664-926f-f2dc32b82876 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:25 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e879e7c-2dbd-428b-b612-2ad727085dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488e78fc-6e75-4f5f-80e0-6701c645533c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 1073741824
Sep 09 13:32:25 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ba26f4-3c6f-4c80-8c91-67f2c74f798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-488e78fc-6e75-4f5f-80e0-6701c645533c (488e78fc-6e75-4f5f-80e0-6701c645533c): created successfully
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ba26f4-3c6f-4c80-8c91-67f2c74f798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (3e660bfa-140f-4a76-9072-d4dc71cf54a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (1681df24-0090-4729-9a2a-d508d527dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9317640-7d06-4e98-a6ce-2061ea9014c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-44b36db9-0073-47ef-bd1f-1fb8fa23c1ac tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9317640-7d06-4e98-a6ce-2061ea9014c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355811425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12adbc16-6bd5-4a10-ab97-f91e50a80712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:25Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce34cff-e11c-4447-b3c7-602cdde142ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce34cff-e11c-4447-b3c7-602cdde142ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f0564b-7b21-4da1-9cb1-89cbf47a3089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f0564b-7b21-4da1-9cb1-89cbf47a3089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12adbc16-6bd5-4a10-ab97-f91e50a80712', 'volume_name': 'volume-12adbc16-6bd5-4a10-ab97-f91e50a80712', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1103b5-1644-4566-9d3f-ff418769036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1103b5-1644-4566-9d3f-ff418769036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd507eef-05ee-4c9e-a683-50176b7a3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume 12adbc16-6bd5-4a10-ab97-f91e50a80712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12adbc16-6bd5-4a10-ab97-f91e50a80712', 'volume_size': 1}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:25 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:25 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:25 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:32:25 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 1073741824" returned: 0 in 0.748s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:25 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876
Sep 09 13:32:25 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Flow 'volume_create_manager' (3c216224-914e-4ff8-9dc0-ae0132b76a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2b616-2eb5-415c-ad5a-4a898c7b496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2b616-2eb5-415c-ad5a-4a898c7b496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea52ea4-addb-445b-bd75-2ab91092c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7776c6af3447659ee3de09026afa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='f17417094c3540cebdda94f2e1e5fa2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eaa3da-9790-4294-b49b-4026ce577a63),volume_type_id=27eaa3da-9790-4294-b49b-4026ce577a63)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e7b9c2-829c-488d-875e-360cf282300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e7b9c2-829c-488d-875e-360cf282300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b684e405-46f7-4d59-9ef8-3056d7f336a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:25 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (6a44ae08-925c-4d2e-988b-f2f7aee10974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfeb88c-6b69-4840-8b3c-d511ba78f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfeb88c-6b69-4840-8b3c-d511ba78f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046839802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0441e36f-f0af-4fed-8859-0090257680a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0441e36f-f0af-4fed-8859-0090257680a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b8b126-4bff-4fca-b267-8a38df0499a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b8b126-4bff-4fca-b267-8a38df0499a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda', 'volume_name': 'volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea20d73-cc97-492f-b8e9-7855bc51d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea20d73-cc97-492f-b8e9-7855bc51d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca46b1d-25ea-4afa-a8d2-86a317f071ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda', 'volume_size': 1}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:26 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876" returned: 0 in 0.397s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.485s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1389790499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9e0365-9759-4dbe-9689-baabe6e40bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:23Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Creating volume 0f9e0365-9759-4dbe-9689-baabe6e40bfa {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:26 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa 1073741824
Sep 09 13:32:26 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (dba6934f-eda4-4268-8420-0ab5fdbc8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536ca400-3230-4058-bdf1-ad0402d31e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad7a32e-d8c2-4942-8048-fb0decf663f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c32c2d-3747-4664-926f-f2dc32b82876', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13c596a-6388-4a8f-9a3c-ed87f07ce18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536ca400-3230-4058-bdf1-ad0402d31e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520798761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d0d1ce-e7cb-4702-a70d-ef49778e8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9235ff-7088-40f2-9a2c-f2ba4c46c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9235ff-7088-40f2-9a2c-f2ba4c46c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ffa5a-460b-4187-b920-5f820146d80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ffa5a-460b-4187-b920-5f820146d80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d0d1ce-e7cb-4702-a70d-ef49778e8ea9', 'volume_name': 'volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e376f0-0ee4-457c-a493-b57925871598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e376f0-0ee4-457c-a493-b57925871598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170cc58a-1e69-4851-b391-4c140fa668d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume 91d0d1ce-e7cb-4702-a70d-ef49778e8ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9', 'volume_size': 1}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Volume volume-c1c32c2d-3747-4664-926f-f2dc32b82876 (c1c32c2d-3747-4664-926f-f2dc32b82876): created successfully
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13c596a-6388-4a8f-9a3c-ed87f07ce18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (e6511621-b58b-4642-8e4f-3ef1d2544c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b684e405-46f7-4d59-9ef8-3056d7f336a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ea52ea4-addb-445b-bd75-2ab91092c2a1', 'volume_name': 'volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1', 'volume_size': 1, 'image_id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a60e9e31e5844f4790890577a7a1f472', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb7776c6af3447659ee3de09026afa98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '359b03d6cb282d3296f09ec2d24a8d7590d408d388e8efd7da7ce057f06d5727552bb495eb033982911c36175b7c56959f9649a0f8078520207ab16d71a224be', 'id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ce17776-eac3-46c9-9c34-d625a8193bb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54601c950>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f8911b-b4a3-4f8c-8742-4c4d42a7b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f8911b-b4a3-4f8c-8742-4c4d42a7b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52c5e23-ba5c-4f7d-be24-592398ac6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1', 'volume_size': 1, 'image_id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a60e9e31e5844f4790890577a7a1f472', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb7776c6af3447659ee3de09026afa98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '359b03d6cb282d3296f09ec2d24a8d7590d408d388e8efd7da7ce057f06d5727552bb495eb033982911c36175b7c56959f9649a0f8078520207ab16d71a224be', 'id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ce17776-eac3-46c9-9c34-d625a8193bb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54601c950>}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Trying to clone 6ea52ea4-addb-445b-bd75-2ab91092c2a1 from image 6ce17776-eac3-46c9-9c34-d625a8193bb5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2fa5b151-cea8-45dc-8d6e-3e0be8e24b19 tempest-CreateVolumesFromImageTest-1386221941 None] Created volume successfully.
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3112b-e61f-4231-b50d-6a685cf9f619]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (e9f52269-e548-4a2e-8ef4-ff4b0ce4d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a0c7b-0aa4-44ff-885e-39dd37ecdbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a0c7b-0aa4-44ff-885e-39dd37ecdbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860471360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07dc024-5dc0-4feb-8be5-5321b8075d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:27Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad1629d-bd8c-4f50-b731-a94861017049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad1629d-bd8c-4f50-b731-a94861017049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4cb5f3-2915-44cd-bd2f-1d8ca0a12f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:26 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4cb5f3-2915-44cd-bd2f-1d8ca0a12f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07dc024-5dc0-4feb-8be5-5321b8075d9c', 'volume_name': 'volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695e3fa6-4c83-4136-aac1-395033713d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695e3fa6-4c83-4136-aac1-395033713d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f92592-7b1e-4ed6-81e6-0eba18ea3658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume b07dc024-5dc0-4feb-8be5-5321b8075d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c', 'volume_size': 1}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa 1073741824" returned: 0 in 0.641s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:27 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa
Sep 09 13:32:27 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:27 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (ea3c434e-40ef-4e88-a0f0-2592f55f3092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4263da-d29a-4c15-b8e6-f1a108474491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4263da-d29a-4c15-b8e6-f1a108474491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143144468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f056fd9-1ab3-4c6c-978c-1478b7f481d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:27Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09473a67-0096-43fe-b310-b1d8deb467c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09473a67-0096-43fe-b310-b1d8deb467c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0558be-fe65-4f80-8180-d4824b7b2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0558be-fe65-4f80-8180-d4824b7b2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f056fd9-1ab3-4c6c-978c-1478b7f481d1', 'volume_name': 'volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54095ae0-25ac-46b2-9043-355558811344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54095ae0-25ac-46b2-9043-355558811344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:27 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccb1515-7e58-4295-9f52-3ec4f690b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume 4f056fd9-1ab3-4c6c-978c-1478b7f481d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1', 'volume_size': 1}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa" returned: 0 in 0.314s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.224s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36876021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5eb023-2ded-4881-b1b9-93c56dbf7432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471417ace69c4969af7bfdd9f2bd3ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:23Z,use_quota=True,user_id='7b6b977b2d624ca99583b8677c4acd60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Creating volume 7b5eb023-2ded-4881-b1b9-93c56dbf7432 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:27 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335a002c-371f-4507-8757-6ce9a0abb920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9006657-4761-4bea-af59-59e696d71286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:27 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 1073741824
Sep 09 13:32:27 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Volume volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa (0f9e0365-9759-4dbe-9689-baabe6e40bfa): created successfully
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9006657-4761-4bea-af59-59e696d71286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (75527080-9f51-4287-bbe6-3b94f3ed9d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ff202596-9d24-475b-909f-dabbb299311f tempest-CreateVolumesFromImageTest-1386221941 None] Created volume successfully.
Sep 09 13:32:27 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Temporary image 6ce17776-eac3-46c9-9c34-d625a8193bb5 is fetched for user f17417094c3540cebdda94f2e1e5fa2a. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8de4d51-5fbf-440f-a908-edb1814e03ee]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:27 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:27 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:27 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 1073741824" returned: 0 in 0.475s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:27 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432
Sep 09 13:32:27 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:27 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:28 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:28 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:28 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432" returned: 0 in 0.281s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.823s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355811425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12adbc16-6bd5-4a10-ab97-f91e50a80712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:25Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume 12adbc16-6bd5-4a10-ab97-f91e50a80712 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:28 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fe0b53-34da-4df2-aab4-aa31d16bd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:28 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 1073741824
Sep 09 13:32:28 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0a61a6-98eb-4fe6-aa2c-2e9d0ba9528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Volume volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 (7b5eb023-2ded-4881-b1b9-93c56dbf7432): created successfully
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0a61a6-98eb-4fe6-aa2c-2e9d0ba9528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Flow 'volume_create_manager' (2b7c0747-01d3-47bd-9a0d-c5cd33dbde8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fd07d1b5-ded5-47e9-a8e6-e5218d1aa2a4 tempest-CreateVolumesFromImageTest-1386221941 None] Created volume successfully.
Sep 09 13:32:28 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:28 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 1073741824" returned: 0 in 0.423s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:28 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712
Sep 09 13:32:28 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:28 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.799s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd507eef-05ee-4c9e-a683-50176b7a3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12adbc16-6bd5-4a10-ab97-f91e50a80712', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc55302c-895f-4903-ad7c-f4d2c4c4ff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating offline snapshot 3b49372a-ba9c-43c6-a4b2-87060984ee3e of volume 488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:32:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 (12adbc16-6bd5-4a10-ab97-f91e50a80712): created successfully
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc55302c-895f-4903-ad7c-f4d2c4c4ff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (1681df24-0090-4729-9a2a-d508d527dc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9309d2ee-84bf-46f7-ba62-4078291cf8fb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5af7f0a5-dd25-4cde-b073-2ed6c2c129f7 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:28 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c
Sep 09 13:32:28 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:29 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c" returned: 0 in 0.381s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:29 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e 1G
Sep 09 13:32:29 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-7b5eb023-2ded-4881-b1b9-93c56dbf7432-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-7b5eb023-2ded-4881-b1b9-93c56dbf7432-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-quobyte-7b5eb023-2ded-4881-b1b9-93c56dbf7432" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-7b5eb023-2ded-4881-b1b9-93c56dbf7432" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f0845c-6c59-4a2f-b32a-426d1e4d7382]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:29 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432
Sep 09 13:32:29 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:29 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e 1G" returned: 0 in 0.424s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488e78fc-6e75-4f5f-80e0-6701c645533c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:29 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488e78fc-6e75-4f5f-80e0-6701c645533c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e
Sep 09 13:32:29 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:29 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:29 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432
Sep 09 13:32:29 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:29 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488e78fc-6e75-4f5f-80e0-6701c645533c -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:29 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e is being set with open permissions: ugo+rw
Sep 09 13:32:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e
Sep 09 13:32:30 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7b5eb023-2ded-4881-b1b9-93c56dbf7432" returned: 0 in 0.269s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-7b5eb023-2ded-4881-b1b9-93c56dbf7432" released by "delete_volume" :: held 0.688s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Created reservations ['b6c2ed93-2d46-4b70-a8fd-d64ea799605a', '7c95b6c5-2b0b-4f4f-84aa-070afed015b9', '71cecf7d-4e0f-41ca-af67-8191d48833ae', '9c20b3af-86d4-48bf-a4bc-67803743f584'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:30 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e" returned: 0 in 0.258s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info
Sep 09 13:32:30 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-0f9e0365-9759-4dbe-9689-baabe6e40bfa-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Deleted volume successfully.
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-0f9e0365-9759-4dbe-9689-baabe6e40bfa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d6e66102-c56a-4d0b-a4c1-422e6cdfafa6 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-7b5eb023-2ded-4881-b1b9-93c56dbf7432-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-quobyte-0f9e0365-9759-4dbe-9689-baabe6e40bfa" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-0f9e0365-9759-4dbe-9689-baabe6e40bfa" acquired by "delete_volume" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:30 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info" returned: 0 in 0.277s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info is being set with open permissions: ugo+rw
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1afebfb-ec98-41ef-948e-b7bc1c907213]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info
Sep 09 13:32:30 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa
Sep 09 13:32:30 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.info" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.735s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046839802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:30 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda 1073741824
Sep 09 13:32:30 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6cdf0065-4104-4c63-b29d-fd00091271ff tempest-CreateVolumesFromSnapshotTest-1096770008 None] Create snapshot completed successfully
Sep 09 13:32:30 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa" returned: 0 in 0.387s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:30 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa
Sep 09 13:32:30 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:31 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0f9e0365-9759-4dbe-9689-baabe6e40bfa" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-0f9e0365-9759-4dbe-9689-baabe6e40bfa" released by "delete_volume" :: held 0.731s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Created reservations ['df6280c8-7caa-4c44-be66-d9b59547cc74', 'ced07edc-1074-4b74-8004-5efdbfb7aa53', 'f43e2be4-eca0-426e-b7bd-5b7f9389cebd', 'ec96f31a-d50d-49f5-af06-7226d6af04a7'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:31 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda 1073741824" returned: 0 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:31 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda
Sep 09 13:32:31 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:31 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:31 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:31 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" returned: 0 in 0.315s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-c1c32c2d-3747-4664-926f-f2dc32b82876-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.346s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520798761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d0d1ce-e7cb-4702-a70d-ef49778e8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume 91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:31 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:31 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 1073741824
Sep 09 13:32:31 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (219cfa4e-a91b-4d08-a5f6-f3248ad3d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f91ac4c-9487-4a05-aee6-ef21c501f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca46b1d-25ea-4afa-a8d2-86a317f071ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7e48e-1b99-4e67-9090-769b6370d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-c1c32c2d-3747-4664-926f-f2dc32b82876-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f91ac4c-9487-4a05-aee6-ef21c501f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183289794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af82faa7-2caa-4410-bb56-b15d96a5c8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b393ab72-19fd-4e24-90ec-2ae961688125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b393ab72-19fd-4e24-90ec-2ae961688125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f2da0-8010-4618-a9a2-91ab25df17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f2da0-8010-4618-a9a2-91ab25df17db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af82faa7-2caa-4410-bb56-b15d96a5c8b2', 'volume_name': 'volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c804f5-e613-4430-9b66-a83c9fbc9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c804f5-e613-4430-9b66-a83c9fbc9a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f39cfe7-bb50-41ab-854d-2d9fc16c40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:31 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume af82faa7-2caa-4410-bb56-b15d96a5c8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2', 'volume_size': 1}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.436s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:31 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Deleted volume successfully.
Sep 09 13:32:31 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda (e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda): created successfully
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7e48e-1b99-4e67-9090-769b6370d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (6a44ae08-925c-4d2e-988b-f2f7aee10974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:31 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ebd6ed72-8d89-4802-b834-69fa6420c616 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e1cf4dfc-aa20-464e-8183-5eeab31e0329 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-0f9e0365-9759-4dbe-9689-baabe6e40bfa-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-quobyte-c1c32c2d-3747-4664-926f-f2dc32b82876" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-c1c32c2d-3747-4664-926f-f2dc32b82876" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e37d1-5db0-4be6-9fd0-52a1ad1f529a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:32 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876
Sep 09 13:32:32 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (5eff7029-bf5a-4d68-bae3-b13bc1194f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de266bc2-b6d2-40ce-8e30-df29989b56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de266bc2-b6d2-40ce-8e30-df29989b56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267324168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76305191-e2bd-472e-91e9-c0694f9ea579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad531d7e-a66e-4eed-91c0-523b4aab144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad531d7e-a66e-4eed-91c0-523b4aab144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7bda97-49e6-4fbb-8cbf-4c50f5dcdba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7bda97-49e6-4fbb-8cbf-4c50f5dcdba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76305191-e2bd-472e-91e9-c0694f9ea579', 'volume_name': 'volume-76305191-e2bd-472e-91e9-c0694f9ea579', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25076097-5b4c-4918-aff9-4c003c7ed2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25076097-5b4c-4918-aff9-4c003c7ed2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a8cb01-0533-471f-bf71-92292c3501b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume 76305191-e2bd-472e-91e9-c0694f9ea579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76305191-e2bd-472e-91e9-c0694f9ea579', 'volume_size': 1}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:32 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 1073741824" returned: 0 in 0.646s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:32 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9
Sep 09 13:32:32 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:32 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (6b88ec94-6d33-4470-bb9c-f85ae9bcd690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59bfc1b-27b1-46db-8402-6bf43d473555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876" returned: 0 in 0.570s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59bfc1b-27b1-46db-8402-6bf43d473555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439064027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707a01fb-4ee3-435b-a9eb-2053c85bbdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876
Sep 09 13:32:32 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d8e64-a946-4860-81e1-2a1173188b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d8e64-a946-4860-81e1-2a1173188b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42761a7-04bd-4ce3-bb3a-14c3fbe3499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42761a7-04bd-4ce3-bb3a-14c3fbe3499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707a01fb-4ee3-435b-a9eb-2053c85bbdc6', 'volume_name': 'volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ba8e1b-2218-4abb-bed2-3e8281a7e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ba8e1b-2218-4abb-bed2-3e8281a7e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7e32ac-106b-448f-ac5b-d3ad799c1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume 707a01fb-4ee3-435b-a9eb-2053c85bbdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6', 'volume_size': 1}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:32 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860471360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07dc024-5dc0-4feb-8be5-5321b8075d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:27Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume b07dc024-5dc0-4feb-8be5-5321b8075d9c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:32 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:32 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c 1073741824
Sep 09 13:32:32 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170cc58a-1e69-4851-b391-4c140fa668d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86287cec-9668-4a1b-a978-47b23ade6cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:32 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 (91d0d1ce-e7cb-4702-a70d-ef49778e8ea9): created successfully
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86287cec-9668-4a1b-a978-47b23ade6cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (dba6934f-eda4-4268-8420-0ab5fdbc8a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:32 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c1c32c2d-3747-4664-926f-f2dc32b82876" returned: 0 in 0.359s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-841b4045-4a6d-4fce-92c4-c001ed8b3468 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-c1c32c2d-3747-4664-926f-f2dc32b82876" released by "delete_volume" :: held 1.000s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:32 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (51dde01a-f202-40a2-b6d0-d9245a170b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b78741c-2569-465b-868c-7b45f1634fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b78741c-2569-465b-868c-7b45f1634fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1242092470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c47902-9ae8-4d80-be92-4a44b5e8e1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:33Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e68abb-9fc1-4ed5-96c8-cf8ff5e626a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e68abb-9fc1-4ed5-96c8-cf8ff5e626a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27206edb-f84d-4625-b157-cb7deab1fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27206edb-f84d-4625-b157-cb7deab1fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c47902-9ae8-4d80-be92-4a44b5e8e1f2', 'volume_name': 'volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a04f01a-c482-4dfb-8c2d-b0ffc90e0040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a04f01a-c482-4dfb-8c2d-b0ffc90e0040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba5736a-6f3c-4675-87c9-a12d1bc8bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume f0c47902-9ae8-4d80-be92-4a44b5e8e1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2', 'volume_size': 1}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Created reservations ['98d1b708-2f51-4dcc-8a35-e7e2c7ca0715', 'e97b0bc0-148c-4d5d-ac62-ac3d82133dbf', 'f7f033de-c422-4f1b-b42d-db92e9857acb', '258fec07-384a-4125-951f-79bc1db608c4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:33 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:33 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:33 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c 1073741824" returned: 0 in 0.607s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (6db3c403-ac11-405f-a9e0-e83d8087ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:33 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055475ed-0278-4acb-a94a-d64edd1e3e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Deleted volume successfully.
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055475ed-0278-4acb-a94a-d64edd1e3e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200679574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118057a1-d928-434d-be0e-2cd8599a3d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:33Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5204686-08a7-4628-be77-1c298066e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack sudo[107071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c
Sep 09 13:32:33 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5204686-08a7-4628-be77-1c298066e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843934ab-fdc7-49b7-be74-12a8834c12b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843934ab-fdc7-49b7-be74-12a8834c12b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118057a1-d928-434d-be0e-2cd8599a3d28', 'volume_name': 'volume-118057a1-d928-434d-be0e-2cd8599a3d28', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bc69b9-c93c-46b5-bd12-5022c1bdb470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bc69b9-c93c-46b5-bd12-5022c1bdb470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baae5dba-76a9-48a6-a594-0e38f042f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume 118057a1-d928-434d-be0e-2cd8599a3d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118057a1-d928-434d-be0e-2cd8599a3d28', 'volume_size': 1}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-75fd089f-0eb8-4fb3-92d4-ec08d2ce3c73 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-c1c32c2d-3747-4664-926f-f2dc32b82876-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:33 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.604s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143144468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f056fd9-1ab3-4c6c-978c-1478b7f481d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7be2dc435bc42ad94d944a2c6475d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:27Z,use_quota=True,user_id='11c54b7403cc4a528287c7716b641586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Creating volume 4f056fd9-1ab3-4c6c-978c-1478b7f481d1 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f92592-7b1e-4ed6-81e6-0eba18ea3658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 1073741824
Sep 09 13:32:33 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbb9e44-e986-4807-b1a3-9a5df7a7c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c (b07dc024-5dc0-4feb-8be5-5321b8075d9c): created successfully
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbb9e44-e986-4807-b1a3-9a5df7a7c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (e9f52269-e548-4a2e-8ef4-ff4b0ce4d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b829fa9e-834a-43ad-abe9-300bbaf6c5fa tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-0e9eb4b0-8106-4cbe-9255-f60472f90efd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-0e9eb4b0-8106-4cbe-9255-f60472f90efd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-quobyte-0e9eb4b0-8106-4cbe-9255-f60472f90efd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-0e9eb4b0-8106-4cbe-9255-f60472f90efd" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3383f2-d31a-409a-bd90-8a91b86bc9b0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:34 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd
Sep 09 13:32:34 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:34 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 1073741824" returned: 0 in 0.459s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:34 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1
Sep 09 13:32:34 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:34 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd" returned: 0 in 0.395s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:34 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd
Sep 09 13:32:34 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:34 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.367s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea52ea4-addb-445b-bd75-2ab91092c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7776c6af3447659ee3de09026afa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:26Z,use_quota=True,user_id='f17417094c3540cebdda94f2e1e5fa2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eaa3da-9790-4294-b49b-4026ce577a63),volume_type_id=27eaa3da-9790-4294-b49b-4026ce577a63)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Creating volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:34 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:34 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1073741824
Sep 09 13:32:34 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccb1515-7e58-4295-9f52-3ec4f690b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74326452-5b0b-4b13-885f-fbdabc2c8a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Volume volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 (4f056fd9-1ab3-4c6c-978c-1478b7f481d1): created successfully
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74326452-5b0b-4b13-885f-fbdabc2c8a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:34 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Flow 'volume_create_manager' (ea3c434e-40ef-4e88-a0f0-2592f55f3092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0e9eb4b0-8106-4cbe-9255-f60472f90efd" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-4d6dee18-f7db-4611-a361-3023bfe8c9a3 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created volume successfully.
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-0e9eb4b0-8106-4cbe-9255-f60472f90efd" released by "delete_volume" :: held 0.707s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Created reservations ['d213c85f-b527-41a6-a597-68d87d807355', 'ff98bff2-bf0b-46b8-9b39-47b47c8dd104', 'e5a32379-d36d-420e-aba7-2be43022993e', 'd60ca514-843a-4578-8968-f26828022908'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:34 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:34 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-4f056fd9-1ab3-4c6c-978c-1478b7f481d1-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-4f056fd9-1ab3-4c6c-978c-1478b7f481d1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" acquired by "delete_volume" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6bb84f-a8af-4016-9f0d-29761f72a40a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-4a8dbd68-efd7-48f7-9326-660aa78ec414-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:35 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-4a8dbd68-efd7-48f7-9326-660aa78ec414-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:35 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1
Sep 09 13:32:35 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.328s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:35 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Deleted volume successfully.
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1073741824" returned: 0 in 0.587s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1bbc04a4-cf2f-4521-9432-8ecfc93a24cf tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-0e9eb4b0-8106-4cbe-9255-f60472f90efd-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "cinder-quobyte-4a8dbd68-efd7-48f7-9326-660aa78ec414" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-4a8dbd68-efd7-48f7-9326-660aa78ec414" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:35 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1
Sep 09 13:32:35 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b215e8b6-1cc4-453f-a792-9cc31069c5f0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414
Sep 09 13:32:35 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" returned: 0 in 0.439s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1
Sep 09 13:32:35 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1" returned: 0 in 0.281s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183289794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af82faa7-2caa-4410-bb56-b15d96a5c8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume af82faa7-2caa-4410-bb56-b15d96a5c8b2 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:35 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 1073741824
Sep 09 13:32:35 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Attempting download of 6ce17776-eac3-46c9-9c34-d625a8193bb5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}])) to volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[896a960b-8546-46a7-b26d-1aebfe8aaa2f]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" returned: 0 in 0.291s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:35 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414
Sep 09 13:32:35 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-4f056fd9-1ab3-4c6c-978c-1478b7f481d1" released by "delete_volume" :: held 0.775s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:35 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge
Sep 09 13:32:35 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['4ce58fa8-d5c8-4fca-bb24-929c0033c7ee', '1d487597-58ab-4f5c-9a83-9e25f8be84d1', '7bbaddfe-2692-4a05-b812-ba71aa0b70e7', '3630b9d3-8cc7-496c-aac9-4eef0f9202d2'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:35 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:35 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-4a8dbd68-efd7-48f7-9326-660aa78ec414" returned: 0 in 0.326s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-quobyte-4a8dbd68-efd7-48f7-9326-660aa78ec414" released by "delete_volume" :: held 0.816s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-b07dc024-5dc0-4feb-8be5-5321b8075d9c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:36 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 1073741824" returned: 0 in 0.586s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-b07dc024-5dc0-4feb-8be5-5321b8075d9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:36 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge
Sep 09 13:32:36 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.321s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-b07dc024-5dc0-4feb-8be5-5321b8075d9c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Created reservations ['bb140216-62e0-45f4-b823-96ee5f88294e', '0f2f0dab-fd6c-44f6-9227-d0fa04408cae', '7dcf2135-1f08-4e40-ab0b-c1211de4150a', 'fa80aadd-afdf-449b-9e8c-3280ceac95a3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:36 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2
Sep 09 13:32:36 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-b07dc024-5dc0-4feb-8be5-5321b8075d9c" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[59751afd-e843-44b2-b940-4b7da3ff5028]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b4ad04cf-4b1b-4cee-9d95-03cb050dac96 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-4f056fd9-1ab3-4c6c-978c-1478b7f481d1-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:36 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge" returned: 1 in 0.417s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ce17776-eac3-46c9-9c34-d625a8193bb5_nb4j_3ge' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1c1d4-f519-4018-be06-6e52ce0fdb49]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c
Sep 09 13:32:36 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:36 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:36 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.446s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267324168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76305191-e2bd-472e-91e9-c0694f9ea579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume 76305191-e2bd-472e-91e9-c0694f9ea579 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:36 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 1073741824
Sep 09 13:32:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f39cfe7-bb50-41ab-854d-2d9fc16c40ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4361ef32-a6dd-40cb-b4fa-6fd83b129db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:36 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 (af82faa7-2caa-4410-bb56-b15d96a5c8b2): created successfully
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4361ef32-a6dd-40cb-b4fa-6fd83b129db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (219cfa4e-a91b-4d08-a5f6-f3248ad3d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2c237b69-ba8a-44c7-8f77-4e4a1f2c418a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:36 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.310s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Deleted volume successfully.
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-42c78f2a-0102-473f-9914-c47fe5413c06 tempest-CreateVolumesFromImageTest-1386221941 None] Lock "cinder-4a8dbd68-efd7-48f7-9326-660aa78ec414-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:36 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c" returned: 0 in 0.497s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:36 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c
Sep 09 13:32:36 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD
Sep 09 13:32:37 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-b07dc024-5dc0-4feb-8be5-5321b8075d9c" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-b07dc024-5dc0-4feb-8be5-5321b8075d9c" released by "delete_volume" :: held 0.814s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 1073741824" returned: 0 in 0.523s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] 6ce17776-eac3-46c9-9c34-d625a8193bb5 was raw, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:37 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1
Sep 09 13:32:37 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['72f0bea0-7633-42e9-8b8c-afcf5a62b8c4', 'f8bea5a1-dda0-4dbd-828a-848a769d8784', '6c5bdcb0-6c82-4b2e-8562-a63767791071', 'a48de3d8-ca60-471a-b826-0a603e9284de'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:37 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:37 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:37 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579" returned: 0 in 0.435s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.058s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439064027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707a01fb-4ee3-435b-a9eb-2053c85bbdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:32Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume 707a01fb-4ee3-435b-a9eb-2053c85bbdc6 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:37 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:37 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 1073741824
Sep 09 13:32:37 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a8cb01-0533-471f-bf71-92292c3501b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76305191-e2bd-472e-91e9-c0694f9ea579', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead24203-9b79-49a8-b84a-3a6d8528ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:37 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-76305191-e2bd-472e-91e9-c0694f9ea579 (76305191-e2bd-472e-91e9-c0694f9ea579): created successfully
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead24203-9b79-49a8-b84a-3a6d8528ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (5eff7029-bf5a-4d68-bae3-b13bc1194f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.339s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1ecc7138-4f90-4db3-a4d9-a06936752780 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9ea118e8-8a6a-474e-8816-432129f3816b tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-b07dc024-5dc0-4feb-8be5-5321b8075d9c-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:37 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1" returned: 0 in 0.640s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ce17776-eac3-46c9-9c34-d625a8193bb5_l1mfktgbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:32:37 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 13:32:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:37 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1G
Sep 09 13:32:37 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:38 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 1073741824" returned: 0 in 0.501s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:38 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 1G" returned: 0 in 0.355s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Downloaded image 6ce17776-eac3-46c9-9c34-d625a8193bb5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}])) to volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Temporary image 6ce17776-eac3-46c9-9c34-d625a8193bb5 for user f17417094c3540cebdda94f2e1e5fa2a is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Marking volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Copying metadata from image 6ce17776-eac3-46c9-9c34-d625a8193bb5 to 6ea52ea4-addb-445b-bd75-2ab91092c2a1. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Creating volume glance metadata for volume 6ea52ea4-addb-445b-bd75-2ab91092c2a1 backed by image 6ce17776-eac3-46c9-9c34-d625a8193bb5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a60e9e31e5844f4790890577a7a1f472', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:38 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6
Sep 09 13:32:38 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52c5e23-ba5c-4f7d-be24-592398ac6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1', 'volume_size': 1, 'image_id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ce17776-eac3-46c9-9c34-d625a8193bb5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a60e9e31e5844f4790890577a7a1f472', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb7776c6af3447659ee3de09026afa98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '359b03d6cb282d3296f09ec2d24a8d7590d408d388e8efd7da7ce057f06d5727552bb495eb033982911c36175b7c56959f9649a0f8078520207ab16d71a224be', 'id': '6ce17776-eac3-46c9-9c34-d625a8193bb5', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ce17776-eac3-46c9-9c34-d625a8193bb5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab54601c950>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2747e2-3224-4186-90d4-292a68187035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Volume volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 (6ea52ea4-addb-445b-bd75-2ab91092c2a1): created successfully
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2747e2-3224-4186-90d4-292a68187035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Flow 'volume_create_manager' (3c216224-914e-4ff8-9dc0-ae0132b76a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-56d248a7-bc7a-473d-8571-eaa0277155ec tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Created volume successfully.
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd29ee-7aee-40e2-8fef-d60a944ce702]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:38 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" returned: 0 in 0.388s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.626s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1242092470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c47902-9ae8-4d80-be92-4a44b5e8e1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:33Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:38 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7e32ac-106b-448f-ac5b-d3ad799c1c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:38 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9
Sep 09 13:32:38 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:38 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 1073741824
Sep 09 13:32:38 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96370e75-a7cf-4421-82e2-f6b6b82e2998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 (707a01fb-4ee3-435b-a9eb-2053c85bbdc6): created successfully
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96370e75-a7cf-4421-82e2-f6b6b82e2998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (6b88ec94-6d33-4470-bb9c-f85ae9bcd690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cbc664c5-37cb-4e93-9084-cfba81b7a8a4 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:39 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" returned: 0 in 0.460s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:39 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9
Sep 09 13:32:39 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:39 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 1073741824" returned: 0 in 0.572s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:39 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:39 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2
Sep 09 13:32:39 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9" released by "delete_volume" :: held 0.790s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['a6b44412-f0fe-44cf-ab99-0ee9d74890a0', '1ef388fb-97fa-4709-879b-1fca955f31a8', 'eeabaaff-d5d1-4324-bd5c-a2f95a8f54a7', 'f0d82e62-7c14-473b-9964-0f077086e541'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:39 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:39 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:39 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" returned: 0 in 0.319s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.049s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200679574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118057a1-d928-434d-be0e-2cd8599a3d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c4a28ddba4ab5b2733f5c7791c2c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:33Z,use_quota=True,user_id='95a556b1458a442bb7bf8ccd8c6ed3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Creating volume 118057a1-d928-434d-be0e-2cd8599a3d28 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:39 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:39 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 1073741824
Sep 09 13:32:39 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba5736a-6f3c-4675-87c9-a12d1bc8bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b5d5b2-2dee-471f-9b4c-a3c56ca418bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Acquiring lock "cinder-6ea52ea4-addb-445b-bd75-2ab91092c2a1-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:39 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "cinder-6ea52ea4-addb-445b-bd75-2ab91092c2a1-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:39 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 (f0c47902-9ae8-4d80-be92-4a44b5e8e1f2): created successfully
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b5d5b2-2dee-471f-9b4c-a3c56ca418bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (51dde01a-f202-40a2-b6d0-d9245a170b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:39 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3b3ef1fe-8759-47f4-a171-5a28dc720d50 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3706b047-518e-4006-8a69-b6f1ea374060 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-91d0d1ce-e7cb-4702-a70d-ef49778e8ea9-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Acquiring lock "cinder-quobyte-6ea52ea4-addb-445b-bd75-2ab91092c2a1" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "cinder-quobyte-6ea52ea4-addb-445b-bd75-2ab91092c2a1" acquired by "delete_volume" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[716a53cb-30cc-484f-8589-3249581c2d29]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[593412ce-341f-43d3-a3e5-dd97580c87a3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:40 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda
Sep 09 13:32:40 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:40 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1
Sep 09 13:32:40 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:40 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 1073741824" returned: 0 in 0.638s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:40 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28
Sep 09 13:32:40 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:40 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1" returned: 0 in 0.439s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:40 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" returned: 0 in 0.491s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:40 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1
Sep 09 13:32:40 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:40 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda
Sep 09 13:32:40 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:40 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baae5dba-76a9-48a6-a594-0e38f042f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118057a1-d928-434d-be0e-2cd8599a3d28', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6825f0fc-b399-4af3-8bbe-c3c4bb5aa344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:40 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6ea52ea4-addb-445b-bd75-2ab91092c2a1" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "cinder-quobyte-6ea52ea4-addb-445b-bd75-2ab91092c2a1" released by "delete_volume" :: held 0.792s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:40 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Volume volume-118057a1-d928-434d-be0e-2cd8599a3d28 (118057a1-d928-434d-be0e-2cd8599a3d28): created successfully
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6825f0fc-b399-4af3-8bbe-c3c4bb5aa344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Flow 'volume_create_manager' (6db3c403-ac11-405f-a9e0-e83d8087ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:40 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" returned: 0 in 0.301s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda" released by "delete_volume" :: held 0.883s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-adb67358-5a93-4e68-a746-b66db32445a6 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created volume successfully.
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Created reservations ['8cb2ec88-3914-4e2c-b0f3-6fcbc110cdbc', '3866340e-1d9a-4884-ad0c-615d73c2e6f6', '097b5d45-4287-4676-b42c-6726e7376207', '9bb6ea9d-85e7-43b3-b278-1077039728f3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['d20ae093-2e7c-4d7c-9cc6-45daf44f86a4', 'cd9c71b9-a534-4fa5-bc9b-679106a42f71', '3e44f4e6-970c-4f7d-b454-f1846d3ca7bc', '6e58a7d3-de0a-4d29-ab76-eca429f81d96'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:41 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:41 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:41 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:41 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-118057a1-d928-434d-be0e-2cd8599a3d28-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-118057a1-d928-434d-be0e-2cd8599a3d28-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-118057a1-d928-434d-be0e-2cd8599a3d28" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-118057a1-d928-434d-be0e-2cd8599a3d28" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:41 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Deleted volume successfully.
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe532fda-a363-4109-80f1-2f671a05dfbc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:41 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f3143909-022e-4c5e-bfaf-fdb2548d564c tempest-VolumeAndVolumeTypeFromImageTest-1668229200 None] Lock "cinder-6ea52ea4-addb-445b-bd75-2ab91092c2a1-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6b0fc2a4-c20d-44a2-87b1-6233f62957e6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-e7e47926-2ee8-44b6-ada0-0dfbb2ebbdda-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:41 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28
Sep 09 13:32:41 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:41 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:41 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28
Sep 09 13:32:41 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-12adbc16-6bd5-4a10-ab97-f91e50a80712-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-12adbc16-6bd5-4a10-ab97-f91e50a80712-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:42 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-118057a1-d928-434d-be0e-2cd8599a3d28" returned: 0 in 0.295s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-12adbc16-6bd5-4a10-ab97-f91e50a80712" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-118057a1-d928-434d-be0e-2cd8599a3d28" released by "delete_volume" :: held 0.739s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-12adbc16-6bd5-4a10-ab97-f91e50a80712" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7354676-7193-4239-be4a-0bbe270cd839]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['67c9c614-6ca5-414e-8b76-c58589367b55', '825b8bd2-4de1-4773-b486-f04e7c8b3ae3', '47d2a4b1-916e-4356-84ab-676d4c557a50', 'b4c92344-1914-47c1-9615-de1e174902a4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:42 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712
Sep 09 13:32:42 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:42 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:42 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:42 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712" returned: 0 in 0.536s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:42 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712
Sep 09 13:32:42 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c42422-fba5-462d-b2ba-25e32867d535]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:42 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.443s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-43c8e0f2-322d-4da4-b229-01e987b597a7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-118057a1-d928-434d-be0e-2cd8599a3d28-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:42 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2
Sep 09 13:32:42 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:43 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-12adbc16-6bd5-4a10-ab97-f91e50a80712" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-12adbc16-6bd5-4a10-ab97-f91e50a80712" released by "delete_volume" :: held 0.952s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['ded2ea0e-f54f-4f06-b309-a1d3598b75e6', '8d8d43d7-0d2b-4f08-8995-25022ec81fec', '569d459c-9cb1-4826-9942-4bd0c9a23b1b', '393fb4cf-4091-4b2d-a076-5cd923a0556c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:43 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:43 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:43 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" returned: 0 in 0.545s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:43 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2
Sep 09 13:32:43 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:43 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.339s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:43 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a0feb08c-dcd8-4893-aae9-67cb22251738 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-12adbc16-6bd5-4a10-ab97-f91e50a80712-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:43 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2" released by "delete_volume" :: held 0.959s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['1baf1671-2a85-460e-80c7-c3bfc8eb56ef', '46fa6c40-505b-44d2-855e-e9260af04915', '6e15e901-99bb-4a32-bb15-1d127f074c78', 'e72fa09a-be7b-47ae-b4cf-1320ad005e90'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:43 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:43 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:44 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6356da24-cbed-40df-b4f7-14bc4042d13a tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-f0c47902-9ae8-4d80-be92-4a44b5e8e1f2-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "cinder-quobyte-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e9378-9835-4809-ae91-67f1f0167d38]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:44 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759
Sep 09 13:32:44 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-707a01fb-4ee3-435b-a9eb-2053c85bbdc6-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-707a01fb-4ee3-435b-a9eb-2053c85bbdc6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:44 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" returned: 0 in 0.448s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:44 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759
Sep 09 13:32:44 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17434b8-f504-4a22-8d23-99dda6ea939c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:45 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6
Sep 09 13:32:45 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:45 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" returned: 0 in 0.363s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-quobyte-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759" released by "delete_volume" :: held 0.870s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Created reservations ['61715b8a-a700-4a7c-8e85-b3a8153bda19', 'ca4ac355-5525-4ecb-bbac-af13717d19a0', 'b9a0cc44-4784-41bf-9fba-e4e5885b1719', '703db99e-9a27-4b51-91b6-52277fd71697'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:45 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:45 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:45 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" returned: 0 in 0.582s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:45 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6
Sep 09 13:32:45 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:45 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.451s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:45 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Deleted volume successfully.
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-c204a000-8435-4532-a088-dbd2bf9aeed6 tempest-CreateVolumesFromSourceVolumeTest-993886748 None] Lock "cinder-ef8b38d4-74b9-4f1c-b1ee-979ca85c3759-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:46 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" returned: 0 in 0.464s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-707a01fb-4ee3-435b-a9eb-2053c85bbdc6" released by "delete_volume" :: held 1.116s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['2070cd43-59a4-417f-9f90-77682e754ed5', '24879b76-7f6a-4cdf-b50d-9c98baaa7f89', 'a3f154c2-d7dc-444a-b44e-238e76027d68', '503ecd05-7e90-4a5c-ab0c-b187f86dee08'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:46 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:46 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:46 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.340s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-11263a4a-238c-4047-a1a7-983e7cffd860 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-707a01fb-4ee3-435b-a9eb-2053c85bbdc6-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-76305191-e2bd-472e-91e9-c0694f9ea579-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-76305191-e2bd-472e-91e9-c0694f9ea579-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-76305191-e2bd-472e-91e9-c0694f9ea579" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-76305191-e2bd-472e-91e9-c0694f9ea579" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39914dc-d097-4cb3-9e9b-19d284adcb0c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:47 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579
Sep 09 13:32:47 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:47 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579" returned: 0 in 0.419s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:47 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579
Sep 09 13:32:47 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:47 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-76305191-e2bd-472e-91e9-c0694f9ea579" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-76305191-e2bd-472e-91e9-c0694f9ea579" released by "delete_volume" :: held 0.743s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['de10cee6-1976-4e78-b7fe-1012e464cba2', 'dc947d8e-a2e9-487e-b431-3a0ffe6f8621', '47fc6b62-32ad-4881-a1de-1e51856b086c', '614c8569-56f0-4e6f-948f-a1ffd23742ba'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:48 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:48 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:48 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6e0358eb-5f93-4ac5-b9bb-066c7d2f0a54 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-76305191-e2bd-472e-91e9-c0694f9ea579-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-af82faa7-2caa-4410-bb56-b15d96a5c8b2-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-af82faa7-2caa-4410-bb56-b15d96a5c8b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-af82faa7-2caa-4410-bb56-b15d96a5c8b2" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-af82faa7-2caa-4410-bb56-b15d96a5c8b2" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fa57cb-232d-4204-9685-9ee18321dd4c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:49 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2
Sep 09 13:32:49 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Flow 'volume_create_manager' (02a97056-4828-4c72-971a-f3d6249a7440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2fc9e6-d0b4-4d26-a5d5-f0d7cc941373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2fc9e6-d0b4-4d26-a5d5-f0d7cc941373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809620652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39d81f8-a162-41af-bbf7-95a9c522e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c832f892245487a99b5cf1130266c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:49Z,use_quota=True,user_id='e427a8feae4f4298b89ff2e7c33b6f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae05075-2548-460c-8b34-d860401e383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae05075-2548-460c-8b34-d860401e383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ffa5a3-87f9-455c-9859-2b76bc8d2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ffa5a3-87f9-455c-9859-2b76bc8d2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39d81f8-a162-41af-bbf7-95a9c522e3bd', 'volume_name': 'volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e888b-1a0c-4f2c-bb17-3fe5802f5bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894e888b-1a0c-4f2c-bb17-3fe5802f5bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d384d58-993c-47fc-99fb-f275337efd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Volume e39d81f8-a162-41af-bbf7-95a9c522e3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd', 'volume_size': 1}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809620652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39d81f8-a162-41af-bbf7-95a9c522e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c832f892245487a99b5cf1130266c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:49Z,use_quota=True,user_id='e427a8feae4f4298b89ff2e7c33b6f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Creating volume e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:49 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:49 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd 1073741824
Sep 09 13:32:49 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:49 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2" returned: 0 in 0.428s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:49 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2
Sep 09 13:32:49 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:49 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-af82faa7-2caa-4410-bb56-b15d96a5c8b2" returned: 0 in 0.297s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-af82faa7-2caa-4410-bb56-b15d96a5c8b2" released by "delete_volume" :: held 0.784s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['7dfb6462-40b6-4e98-a1ae-4fe52d43cf7b', '9bb754e2-107f-4fb7-beff-f7a1329bab1a', 'f6911fa3-9d24-466d-8f08-c1c8aba930c6', '1f514109-460c-4b6f-a9cc-d749722d26d4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:49 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd 1073741824" returned: 0 in 0.507s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:49 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:49 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:49 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:32:49 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-3b49372a-ba9c-43c6-a4b2-87060984ee3e-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-3b49372a-ba9c-43c6-a4b2-87060984ee3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-3b49372a-ba9c-43c6-a4b2-87060984ee3e" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-3b49372a-ba9c-43c6-a4b2-87060984ee3e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleting offline snapshot 3b49372a-ba9c-43c6-a4b2-87060984ee3e of volume 488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] snapshot_file for this snap is: volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d122ba-1d4d-4cdb-8c72-5b14b9aa5f11]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:50 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:50 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.332s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.311s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d384d58-993c-47fc-99fb-f275337efd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c9d03-2e4b-466d-975a-da9255c60e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-cd81df61-f9cc-41aa-829e-6fb73b5d38b7 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-af82faa7-2caa-4410-bb56-b15d96a5c8b2-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:50 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Volume volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd (e39d81f8-a162-41af-bbf7-95a9c522e3bd): created successfully
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c9d03-2e4b-466d-975a-da9255c60e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Flow 'volume_create_manager' (02a97056-4828-4c72-971a-f3d6249a7440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-75643615-011a-40a3-94d5-c02f0f4218cb tempest-VolumeDependencyTests-1941650271 None] Created volume successfully.
Sep 09 13:32:50 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e
Sep 09 13:32:50 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:50 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488e78fc-6e75-4f5f-80e0-6701c645533c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ebf1c-f782-46af-9238-847896ef2fe7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:50 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c
Sep 09 13:32:50 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:51 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c" returned: 0 in 0.397s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:51 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e
Sep 09 13:32:51 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:51 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e" returned: 0 in 0.445s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:51 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e
Sep 09 13:32:51 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Creating offline snapshot 6da0e3e2-3619-4044-8692-29c513e21701 of volume e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0467441-4941-461a-8f93-e35dd7811936]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:51 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:32:51 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:51 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c.3b49372a-ba9c-43c6-a4b2-87060984ee3e" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-3b49372a-ba9c-43c6-a4b2-87060984ee3e" released by "_delete_snapshot" :: held 1.654s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" released by "delete_snapshot" :: held 1.693s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['637f9918-af8c-415e-9678-3ea2a2cf0618', '5b7a9c59-2291-49dd-b3d1-b75f735a49f4', '95634f64-4f16-472d-975b-62a0f6923cb0', '5f966e60-31c7-4255-93dc-f353b1543d9c'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Delete snapshot completed successfully.
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-94c4c263-2977-4a9f-a7ce-7cb7d57656a1 tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-3b49372a-ba9c-43c6-a4b2-87060984ee3e-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:51 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.411s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:51 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 1G
Sep 09 13:32:51 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-488e78fc-6e75-4f5f-80e0-6701c645533c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-488e78fc-6e75-4f5f-80e0-6701c645533c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:52 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 1G" returned: 0 in 0.495s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" acquired by "delete_volume" :: waited 0.043s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:52 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:32:52 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96b8d7-478c-4ad2-83e0-e3a74d9c0d20]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:52 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c
Sep 09 13:32:52 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:52 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:52 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 is being set with open permissions: ugo+rw
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:52 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:32:52 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:52 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c" returned: 0 in 0.421s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:53 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c
Sep 09 13:32:53 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:53 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.353s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:53 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info
Sep 09 13:32:53 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:53 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-488e78fc-6e75-4f5f-80e0-6701c645533c" returned: 0 in 0.309s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-quobyte-488e78fc-6e75-4f5f-80e0-6701c645533c" released by "delete_volume" :: held 0.826s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Created reservations ['7903c585-a007-47da-945c-e6964e45dcdc', '314b9cb7-9077-457e-b97f-f5fa2a24563c', '4cd24966-12de-4d58-b609-bc763e80d582', 'ce5e79a9-b999-4e44-b829-e5c2fbb42cc3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:53 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:32:53 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:53 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info" returned: 0 in 0.379s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:53 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info is being set with open permissions: ugo+rw
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:53 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info
Sep 09 13:32:53 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:53 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.393s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:32:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Deleted volume successfully.
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-55d89a66-3fcd-401e-a1bf-55d1a60f61db tempest-CreateVolumesFromSnapshotTest-1096770008 None] Lock "cinder-488e78fc-6e75-4f5f-80e0-6701c645533c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:32:53 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.info" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-30648a17-0999-473a-94e7-caed7b7726a4 tempest-VolumeDependencyTests-1941650271 None] Create snapshot completed successfully
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Flow 'volume_create_manager' (2345e200-94b7-4dd9-a0e5-db9e344756fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402944d0-d19b-43f1-8146-9ce5f5aa17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402944d0-d19b-43f1-8146-9ce5f5aa17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-170301024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dad6483-2338-4df2-9775-85aa8ab25ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c832f892245487a99b5cf1130266c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6da0e3e2-3619-4044-8692-29c513e21701,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:32:55Z,use_quota=True,user_id='e427a8feae4f4298b89ff2e7c33b6f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312e92a0-476f-4989-823d-709d6e5f8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312e92a0-476f-4989-823d-709d6e5f8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21633265-d0a0-48ab-a336-e20cd74166ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21633265-d0a0-48ab-a336-e20cd74166ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8dad6483-2338-4df2-9775-85aa8ab25ab4', 'volume_name': 'volume-8dad6483-2338-4df2-9775-85aa8ab25ab4', 'volume_size': 1, 'snapshot_id': '6da0e3e2-3619-4044-8692-29c513e21701'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d497df7e-fef6-455e-aaea-6e84ce0b4084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d497df7e-fef6-455e-aaea-6e84ce0b4084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50433615-39fa-4d3e-aa81-fca54c294a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:32:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Volume 8dad6483-2338-4df2-9775-85aa8ab25ab4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8dad6483-2338-4df2-9775-85aa8ab25ab4', 'volume_size': 1, 'snapshot_id': '6da0e3e2-3619-4044-8692-29c513e21701'}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701-8dad6483-2338-4df2-9775-85aa8ab25ab4" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701-8dad6483-2338-4df2-9775-85aa8ab25ab4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Creating volume 8dad6483-2338-4df2-9775-85aa8ab25ab4 from snapshot 6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] snapshot: 6da0e3e2-3619-4044-8692-29c513e21701, volume: 8dad6483-2338-4df2-9775-85aa8ab25ab4,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e17dbc-26b3-423a-9305-7a736988f468]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:55 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:32:55 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:56 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b157900-769e-45fb-9a9e-0daed8826320]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:56 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:32:56 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:32:56 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.502s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:32:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:32:56 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4
Sep 09 13:32:56 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4" returned: 0 in 6.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:02 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:33:02 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Converted 1024.00 MB image at 163.23 MB/s
Sep 09 13:33:02 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 is being set with open permissions: ugo+rw
Sep 09 13:33:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:02 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4
Sep 09 13:33:02 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:03 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" released by "_copy_volume_from_snapshot" :: held 7.672s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701-8dad6483-2338-4df2-9775-85aa8ab25ab4" released by "_create_volume_from_snapshot" :: held 7.760s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.784s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50433615-39fa-4d3e-aa81-fca54c294a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dad6483-2338-4df2-9775-85aa8ab25ab4', 'volume_size': 1, 'snapshot_id': '6da0e3e2-3619-4044-8692-29c513e21701'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb33589f-9212-4e6c-ac28-e22537e833ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Volume volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 (8dad6483-2338-4df2-9775-85aa8ab25ab4): created successfully
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb33589f-9212-4e6c-ac28-e22537e833ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Flow 'volume_create_manager' (2345e200-94b7-4dd9-a0e5-db9e344756fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Flow 'volume_create_manager' (aa9447fe-1797-4da9-b789-51dc541d4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d56c2f9-781d-4f71-9873-42a1b4527f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-985fb24d-21cf-4d73-8493-503fa413c690 tempest-VolumeDependencyTests-1941650271 None] Created volume successfully.
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d56c2f9-781d-4f71-9873-42a1b4527f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c131b7f-1ba4-4309-9329-ae115f4ec722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f99ee3bb0f481cb840bab2798f7fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:03Z,use_quota=True,user_id='4689e7b000d74e7fafa69233c14bcf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca8d110-89ec-4b90-8e46-8b5f20124cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca8d110-89ec-4b90-8e46-8b5f20124cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac53725-4471-4c21-abcf-3dc9835d742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.image.glance [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Creating Keystone auth plugin from conf {{(pid=87606) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac53725-4471-4c21-abcf-3dc9835d742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c131b7f-1ba4-4309-9329-ae115f4ec722', 'volume_name': 'volume-3c131b7f-1ba4-4309-9329-ae115f4ec722', 'volume_size': 1, 'image_id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '554abc64fb3ecbc30cc0089f948c3dff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f99ee3bb0f481cb840bab2798f7fdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a07d837408b387489e8cc19224baebef9066f8246c467b854bfa48f3e1be9b4726ee61ee844ab130bbe45ae8022a533db4acb48af676adc65199938cc0ca80', 'id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 33, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53ba83b60>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336a6ccb-b90c-4dc2-8667-d0eb719fd6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336a6ccb-b90c-4dc2-8667-d0eb719fd6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3419244-600b-4c55-ade5-19a15138580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Volume 3c131b7f-1ba4-4309-9329-ae115f4ec722: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c131b7f-1ba4-4309-9329-ae115f4ec722', 'volume_size': 1, 'image_id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '554abc64fb3ecbc30cc0089f948c3dff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f99ee3bb0f481cb840bab2798f7fdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a07d837408b387489e8cc19224baebef9066f8246c467b854bfa48f3e1be9b4726ee61ee844ab130bbe45ae8022a533db4acb48af676adc65199938cc0ca80', 'id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 33, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53ba83b60>}
Sep 09 13:33:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Trying to clone 3c131b7f-1ba4-4309-9329-ae115f4ec722 from image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 at location (None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}]). {{(pid=87606) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 09 13:33:04 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Image download 0.00 MB at 0.00 MB/s
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff716e-89cb-4d98-91a9-1bc8b88f19e4]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:04 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:04 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-6da0e3e2-3619-4044-8692-29c513e21701-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:04 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-6da0e3e2-3619-4044-8692-29c513e21701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Deleting offline snapshot 6da0e3e2-3619-4044-8692-29c513e21701 of volume e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] snapshot_file for this snap is: volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92e0cbb-d4ac-43a3-a014-e6e2224d5fbe]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:04 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:04 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:04 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:33:04 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:04 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:33:04 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Temporary image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 is fetched for user 4689e7b000d74e7fafa69233c14bcf6a. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139287c-1304-46e7-acb5-2bbf02b24736]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:05 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.477s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6a829-95e2-4a5f-933c-153b024eaad2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:05 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:05 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:05 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:33:05 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:05 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:05 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:05 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:05 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c131b7f-1ba4-4309-9329-ae115f4ec722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f99ee3bb0f481cb840bab2798f7fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:03Z,use_quota=True,user_id='4689e7b000d74e7fafa69233c14bcf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Creating volume 3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:05 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:05 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.798s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:06 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1073741824
Sep 09 13:33:06 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:06 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:33:06 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:06 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.480s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:06 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701
Sep 09 13:33:06 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:06 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1073741824" returned: 0 in 0.649s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:06 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722
Sep 09 13:33:06 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:06 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd.6da0e3e2-3619-4044-8692-29c513e21701" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-6da0e3e2-3619-4044-8692-29c513e21701" released by "_delete_snapshot" :: held 2.263s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:06 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" released by "delete_snapshot" :: held 2.304s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Created reservations ['e13bd278-446f-4a32-98cb-b8ab058b2d35', 'a7820435-8816-481d-a5bd-b726ffd95e4a', 'ce6b7129-fabc-48d3-9303-da53b7cc3b42', '1517528d-e57e-4d25-918d-ae25495e8a8a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:07 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Attempting download of 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 ((None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}])) to volume 3c131b7f-1ba4-4309-9329-ae115f4ec722. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 09 13:33:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Delete snapshot completed successfully.
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-a9b1ac0f-7425-452c-b991-33a9d291200f tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-6da0e3e2-3619-4044-8692-29c513e21701-delete_snapshot" released by "delete_snapshot" :: held 2.558s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d673982-482b-4236-aab5-dc3971e72034]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:07 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989
Sep 09 13:33:07 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:07 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989" returned: 0 in 0.401s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:07 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989
Sep 09 13:33:07 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-e39d81f8-a162-41af-bbf7-95a9c522e3bd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-e39d81f8-a162-41af-bbf7-95a9c522e3bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9866d52-a3cf-46ad-b2fb-23fb319cf69a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:08 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989" returned: 1 in 0.476s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_z_fyp989' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[12300e9e-7388-437b-adfb-fe70650661b6]: (4, 'raw') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:08 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:08 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:08 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:33:08 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:08 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:08 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.555s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:08 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd
Sep 09 13:33:08 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:08 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD
Sep 09 13:33:08 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:08 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 was raw, converting to qcow2 {{(pid=87606) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 09 13:33:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:08 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722
Sep 09 13:33:08 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:09 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e39d81f8-a162-41af-bbf7-95a9c522e3bd" returned: 0 in 0.471s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-e39d81f8-a162-41af-bbf7-95a9c522e3bd" released by "delete_volume" :: held 1.111s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Created reservations ['819ed8be-81a8-4e52-ae72-b41d5191829f', '6e0905e6-58bf-4850-83ac-31404107645f', '7bf0829c-4876-4ffd-982e-fc07741ed360', 'c51133dc-01ac-4c51-bb1a-2319de4a70e4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:09 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:09 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:09 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722" returned: 0 in 0.649s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_671c6dc6-f2e8-4ba1-82f7-87834e6e0352_5qzq2rnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:33:09 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Converted 0.00 MB image at 0.00 MB/s
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:09 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1G
Sep 09 13:33:09 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:09 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Deleted volume successfully.
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b66d3add-9a1f-4333-a3f2-2322f926c872 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-e39d81f8-a162-41af-bbf7-95a9c522e3bd-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:09 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 1G" returned: 0 in 0.361s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Downloaded image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 ((None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}])) to volume 3c131b7f-1ba4-4309-9329-ae115f4ec722 successfully. {{(pid=87606) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Temporary image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 for user 4689e7b000d74e7fafa69233c14bcf6a is deleted. {{(pid=87606) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.volume_utils [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Marking volume 3c131b7f-1ba4-4309-9329-ae115f4ec722 as bootable. {{(pid=87606) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Copying metadata from image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 to 3c131b7f-1ba4-4309-9329-ae115f4ec722. {{(pid=87606) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 09 13:33:09 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Creating volume glance metadata for volume 3c131b7f-1ba4-4309-9329-ae115f4ec722 backed by image 671c6dc6-f2e8-4ba1-82f7-87834e6e0352 with: {'image_id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '554abc64fb3ecbc30cc0089f948c3dff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87606) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3419244-600b-4c55-ade5-19a15138580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c131b7f-1ba4-4309-9329-ae115f4ec722', 'volume_size': 1, 'image_id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '554abc64fb3ecbc30cc0089f948c3dff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6f99ee3bb0f481cb840bab2798f7fdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7a07d837408b387489e8cc19224baebef9066f8246c467b854bfa48f3e1be9b4726ee61ee844ab130bbe45ae8022a533db4acb48af676adc65199938cc0ca80', 'id': '671c6dc6-f2e8-4ba1-82f7-87834e6e0352', 'created_at': datetime.datetime(2026, 9, 9, 11, 32, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 11, 33, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/671c6dc6-f2e8-4ba1-82f7-87834e6e0352/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ab53ba83b60>}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8f732f-a770-487b-935b-05ed91fb5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:10 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Volume volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 (3c131b7f-1ba4-4309-9329-ae115f4ec722): created successfully
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8f732f-a770-487b-935b-05ed91fb5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Flow 'volume_create_manager' (aa9447fe-1797-4da9-b789-51dc541d4c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2aa74b88-7ced-442a-82ce-3188723b89ba tempest-VolumeImageDependencyTests-740473069 None] Created volume successfully.
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-8dad6483-2338-4df2-9775-85aa8ab25ab4-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-8dad6483-2338-4df2-9775-85aa8ab25ab4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" acquired by "delete_volume" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d70bf-9c2d-436c-9f2e-65f87e85f836]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:10 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4
Sep 09 13:33:10 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:10 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:10 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4
Sep 09 13:33:10 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:11 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8dad6483-2338-4df2-9775-85aa8ab25ab4" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-quobyte-8dad6483-2338-4df2-9775-85aa8ab25ab4" released by "delete_volume" :: held 0.799s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Acquiring lock "cinder-3c131b7f-1ba4-4309-9329-ae115f4ec722-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "cinder-3c131b7f-1ba4-4309-9329-ae115f4ec722-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Acquiring lock "cinder-quobyte-3c131b7f-1ba4-4309-9329-ae115f4ec722" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Created reservations ['d1394614-47d8-4611-8087-c9346c5ef5a7', 'f6185a4a-9246-443f-9f74-8a85f7bcc8f5', 'cd6a7d97-7fc9-446f-85a9-e44b12438f14', '41080b1f-82cd-4619-abaa-82a8304302d3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "cinder-quobyte-3c131b7f-1ba4-4309-9329-ae115f4ec722" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7512c59c-86c1-4ac8-a1d2-d16828a30857]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:11 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722
Sep 09 13:33:11 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:11 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:11 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:11 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:11 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Deleted volume successfully.
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb96407-f6bc-4574-97d9-21add0b69268 tempest-VolumeDependencyTests-1941650271 None] Lock "cinder-8dad6483-2338-4df2-9775-85aa8ab25ab4-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:11 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722" returned: 0 in 0.569s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:11 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722
Sep 09 13:33:11 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:12 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-3c131b7f-1ba4-4309-9329-ae115f4ec722" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "cinder-quobyte-3c131b7f-1ba4-4309-9329-ae115f4ec722" released by "delete_volume" :: held 1.025s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Created reservations ['d31b6d6c-8bfd-4c5e-9995-5ce99717b5e4', '4b196c0e-ff29-4665-8df5-0bd09c5d909c', '5fee7ab5-bda4-4bd1-a500-b706a6e0460d', 'e7f256ad-549a-4bd3-8e9a-3c465ce95667'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:12 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:12 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:12 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.424s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Deleted volume successfully.
Sep 09 13:33:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f5434081-8caf-4310-b503-1155f22b47f2 tempest-VolumeImageDependencyTests-740473069 None] Lock "cinder-3c131b7f-1ba4-4309-9329-ae115f4ec722-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Flow 'volume_create_manager' (710816d9-d083-4f94-9279-b6ecf19f2bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594918ed-62da-482f-bbd9-8fdadd31ab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594918ed-62da-482f-bbd9-8fdadd31ab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a26655-1f71-4239-8b31-f2920589b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e4ebdaab44b07acf97003a3307384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:17Z,use_quota=True,user_id='0471377f4a914394a67e08580e3abec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9102ca5-54f8-4cfb-af2d-f6c1b40ceb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9102ca5-54f8-4cfb-af2d-f6c1b40ceb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec41cd0-5e16-4fb9-a889-9238f1d26cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec41cd0-5e16-4fb9-a889-9238f1d26cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a26655-1f71-4239-8b31-f2920589b41c', 'volume_name': 'volume-16a26655-1f71-4239-8b31-f2920589b41c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7011e162-14e7-455d-8103-b456ee12a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7011e162-14e7-455d-8103-b456ee12a071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eddbe4-66ee-45d3-a3af-239f596471d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Volume 16a26655-1f71-4239-8b31-f2920589b41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a26655-1f71-4239-8b31-f2920589b41c', 'volume_size': 1}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a26655-1f71-4239-8b31-f2920589b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e4ebdaab44b07acf97003a3307384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:17Z,use_quota=True,user_id='0471377f4a914394a67e08580e3abec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Creating volume 16a26655-1f71-4239-8b31-f2920589b41c {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:17 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:17 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c 1073741824
Sep 09 13:33:17 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (f65a6b90-6645-47ad-a782-a6b3fed224d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841a0f45-05d5-4206-af22-672db94ea8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841a0f45-05d5-4206-af22-672db94ea8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461254545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8f9b94-3d87-4c8e-8af6-2fa662686a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:17Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83927ea0-205f-4dd4-8929-45a2f2e4a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83927ea0-205f-4dd4-8929-45a2f2e4a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7ecac0-9439-4a59-a9f5-9f2fe35a4e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7ecac0-9439-4a59-a9f5-9f2fe35a4e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8f9b94-3d87-4c8e-8af6-2fa662686a3f', 'volume_name': 'volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ab822b-09a4-4e3c-8136-69d8e11d6913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ab822b-09a4-4e3c-8136-69d8e11d6913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc615dd-8c00-44ba-8767-9a5804426385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Volume eb8f9b94-3d87-4c8e-8af6-2fa662686a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f', 'volume_size': 1}
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:17 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c 1073741824" returned: 0 in 0.549s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:18 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c
Sep 09 13:33:18 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:18 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c" returned: 0 in 0.344s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461254545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8f9b94-3d87-4c8e-8af6-2fa662686a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:17Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Creating volume eb8f9b94-3d87-4c8e-8af6-2fa662686a3f {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:18 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eddbe4-66ee-45d3-a3af-239f596471d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a26655-1f71-4239-8b31-f2920589b41c', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:18 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f 1073741824
Sep 09 13:33:18 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea3423-467b-4088-98f0-fdcef87e9508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:18 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Volume volume-16a26655-1f71-4239-8b31-f2920589b41c (16a26655-1f71-4239-8b31-f2920589b41c): created successfully
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea3423-467b-4088-98f0-fdcef87e9508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Flow 'volume_create_manager' (710816d9-d083-4f94-9279-b6ecf19f2bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-b963603b-41e9-490a-9e19-dde0a5b55a87 tempest-ProjectAdminTests-1944084508 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3740043640137, 'free_capacity_gb': 1773.3740043640137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87606) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 09 13:33:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e87cadf5-566a-4cf7-83b9-baada4a09335 tempest-CinderUnicodeTest-1434607970 None] Created volume successfully.
Sep 09 13:33:18 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f 1073741824" returned: 0 in 0.503s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:19 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f
Sep 09 13:33:19 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:19 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc615dd-8c00-44ba-8767-9a5804426385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0749d546-27a6-4ba8-80d7-716321cb6efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=259,cinder:SELECT=181,cinder:DELETE=24,cinder:INSERT=62 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:33:19 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Volume volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f (eb8f9b94-3d87-4c8e-8af6-2fa662686a3f): created successfully
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0749d546-27a6-4ba8-80d7-716321cb6efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (f65a6b90-6645-47ad-a782-a6b3fed224d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=183,cinder:UPDATE=249,cinder:INSERT=74,cinder:DELETE=21 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:33:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-aff6b74b-d6ba-4f52-bbfe-a5e5f73e942c tempest-ProjectReaderTests-2033289555 None] Created volume successfully.
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Flow 'volume_create_manager' (cc78b276-3c31-4d9a-8dbb-9e1d35958810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771cd328-dc1b-45b3-9f23-6feca71d6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771cd328-dc1b-45b3-9f23-6feca71d6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1367648527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e4ebdaab44b07acf97003a3307384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:20Z,use_quota=True,user_id='0471377f4a914394a67e08580e3abec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e314ca37-60f8-4012-a27c-abfd72c4c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e314ca37-60f8-4012-a27c-abfd72c4c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1f3519-6c71-4ed4-a4c8-f10c96dd1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1f3519-6c71-4ed4-a4c8-f10c96dd1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40', 'volume_name': 'volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c9164c-69cf-435d-ac23-ce06f12c6df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c9164c-69cf-435d-ac23-ce06f12c6df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfb7c51-df65-4121-ae2d-b707936a009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:20 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Volume 7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40', 'volume_size': 1}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1367648527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e4ebdaab44b07acf97003a3307384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:20Z,use_quota=True,user_id='0471377f4a914394a67e08580e3abec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Creating volume 7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:20 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:20 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 1073741824
Sep 09 13:33:20 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "cinder-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-quobyte-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:20 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 1073741824" returned: 0 in 0.697s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" acquired by "delete_volume" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8e6b6-39bc-4742-b215-5cb462cf49d1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:20 devstack sudo[107561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40
Sep 09 13:33:20 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:21 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f
Sep 09 13:33:21 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:21 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" returned: 0 in 0.375s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfb7c51-df65-4121-ae2d-b707936a009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5cfc27-4cf0-4b0b-aad4-c312468e9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Volume volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 (7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40): created successfully
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5cfc27-4cf0-4b0b-aad4-c312468e9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Flow 'volume_create_manager' (cc78b276-3c31-4d9a-8dbb-9e1d35958810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-848f9c60-58ff-41a0-8a06-caa8d7d93475 tempest-CinderUnicodeTest-1434607970 None] Created volume successfully.
Sep 09 13:33:21 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" returned: 0 in 0.581s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:21 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f
Sep 09 13:33:21 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:21 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f" released by "delete_volume" :: held 0.959s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Created reservations ['2b56f346-9655-42d8-a205-223b7f808a35', '4e1d901a-9a32-4cce-b9cd-848920fe73ce', '4d404bff-39e3-4d29-8496-b3f4bce3e908', '24771d30-8531-4454-bf0a-d85d280fbea9'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:21 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:21 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:22 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.463s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Deleted volume successfully.
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-83dde6a5-c02d-4512-9043-be6c48429ded tempest-ProjectReaderTests-2033289555 None] Lock "cinder-eb8f9b94-3d87-4c8e-8af6-2fa662686a3f-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Creating offline snapshot ba757264-3b7d-4d5e-b06b-1654bc426eab of volume 7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0ed2b-2c67-4844-a40e-eb27fdf46d84]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:22 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40
Sep 09 13:33:22 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:23 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" returned: 0 in 0.530s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:23 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab 1G
Sep 09 13:33:23 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (37e31447-0c61-4e3e-82c8-802472a8b4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f55772f-7a20-4e13-bb32-e916047c027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:23 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f55772f-7a20-4e13-bb32-e916047c027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088391130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10942550-8f78-4cc0-ace8-0365de381d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:24Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e2ce1d-cab7-4436-95c9-53bac133a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e2ce1d-cab7-4436-95c9-53bac133a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc297aaf-4e30-471d-a05c-01b24addffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc297aaf-4e30-471d-a05c-01b24addffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10942550-8f78-4cc0-ace8-0365de381d3a', 'volume_name': 'volume-10942550-8f78-4cc0-ace8-0365de381d3a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba65ea2d-f9b9-400d-b057-84c06ba2c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba65ea2d-f9b9-400d-b057-84c06ba2c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e84fbfd-8e34-4e7d-9242-d58557487b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:23 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Volume 10942550-8f78-4cc0-ace8-0365de381d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10942550-8f78-4cc0-ace8-0365de381d3a', 'volume_size': 1}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab 1G" returned: 0 in 0.807s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:23 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab
Sep 09 13:33:24 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:24 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab" returned: 0 in 0.540s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:24 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab is being set with open permissions: ugo+rw
Sep 09 13:33:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:24 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab
Sep 09 13:33:24 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:24 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab" returned: 0 in 0.318s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:24 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info
Sep 09 13:33:24 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:25 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info" returned: 0 in 0.388s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:25 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info is being set with open permissions: ugo+rw
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:25 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info
Sep 09 13:33:25 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:25 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:25 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (8934609e-5af9-4e9d-88a1-5a8721cac2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a913e58a-6430-4a2c-84ac-5d02e60d8bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a913e58a-6430-4a2c-84ac-5d02e60d8bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689743584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a621b7f6-d53b-4052-8bcd-baaaff39814f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:25Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb3e29-d6e5-4b8a-9213-1076217a4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb3e29-d6e5-4b8a-9213-1076217a4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2913e73-32d2-4c86-aff2-2a22ae52e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2913e73-32d2-4c86-aff2-2a22ae52e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a621b7f6-d53b-4052-8bcd-baaaff39814f', 'volume_name': 'volume-a621b7f6-d53b-4052-8bcd-baaaff39814f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03baa46f-d395-4b83-b82c-a69d79a19774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03baa46f-d395-4b83-b82c-a69d79a19774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f94a50-45d5-46d4-9df8-e37adab1eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Volume a621b7f6-d53b-4052-8bcd-baaaff39814f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a621b7f6-d53b-4052-8bcd-baaaff39814f', 'volume_size': 1}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.info" returned: 0 in 0.301s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088391130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10942550-8f78-4cc0-ace8-0365de381d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:24Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Creating volume 10942550-8f78-4cc0-ace8-0365de381d3a {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:25 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:25 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:25 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a 1073741824
Sep 09 13:33:25 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Flow 'volume_create_manager' (41a2c62e-7dba-4d3d-8faa-3f08963073b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799a210-a663-4774-93ee-be4a356e1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.313s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799a210-a663-4774-93ee-be4a356e1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-804196331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769f35a7818744e097c97de298d7b58e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:25Z,use_quota=True,user_id='631b0bf7e0a346ae8c64782893f82507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378d3d1c-6d24-4526-8332-5d9d69cca1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378d3d1c-6d24-4526-8332-5d9d69cca1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b898e877-4cd5-41fa-a2b4-b4cac9c2459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b898e877-4cd5-41fa-a2b4-b4cac9c2459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9', 'volume_name': 'volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bde83bf-5491-4387-87fc-02104c40ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bde83bf-5491-4387-87fc-02104c40ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f48253b-d3e4-4f09-be2a-1e077c6435c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:25 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Volume 6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9', 'volume_size': 1}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:33:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:33:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-cab3e547-8cf0-4313-833a-e9134c7662d7 tempest-CinderUnicodeTest-1434607970 None] Create snapshot completed successfully
Sep 09 13:33:26 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a 1073741824" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:26 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a
Sep 09 13:33:26 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-ba757264-3b7d-4d5e-b06b-1654bc426eab-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-ba757264-3b7d-4d5e-b06b-1654bc426eab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-quobyte-ba757264-3b7d-4d5e-b06b-1654bc426eab" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-ba757264-3b7d-4d5e-b06b-1654bc426eab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Deleting offline snapshot ba757264-3b7d-4d5e-b06b-1654bc426eab of volume 7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:26 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] snapshot_file for this snap is: volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a" returned: 0 in 0.287s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689743584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a621b7f6-d53b-4052-8bcd-baaaff39814f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:25Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Creating volume a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[138001c7-64be-45ed-aaaa-9fbe0c758beb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:26 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f 1073741824
Sep 09 13:33:26 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e84fbfd-8e34-4e7d-9242-d58557487b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10942550-8f78-4cc0-ace8-0365de381d3a', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e36d8-88c6-49ab-9f1c-abcc0941c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Volume volume-10942550-8f78-4cc0-ace8-0365de381d3a (10942550-8f78-4cc0-ace8-0365de381d3a): created successfully
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e36d8-88c6-49ab-9f1c-abcc0941c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (37e31447-0c61-4e3e-82c8-802472a8b4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:26 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-429ae0d1-fd8e-457b-87af-4d357d571fea tempest-ProjectReaderTests-2033289555 None] Created volume successfully.
Sep 09 13:33:26 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab
Sep 09 13:33:26 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:26 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab" returned: 0 in 0.400s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:26 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f 1073741824" returned: 0 in 0.435s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b164b-92a6-4277-8ca9-3a28b892376e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:26 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f
Sep 09 13:33:26 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:26 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40
Sep 09 13:33:26 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f" returned: 0 in 0.251s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-804196331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769f35a7818744e097c97de298d7b58e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:25Z,use_quota=True,user_id='631b0bf7e0a346ae8c64782893f82507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Creating volume 6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:27 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f94a50-45d5-46d4-9df8-e37adab1eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a621b7f6-d53b-4052-8bcd-baaaff39814f', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdfcec1-a7f2-4e46-aeac-dbdce3f0cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:27 devstack sudo[107664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 1073741824
Sep 09 13:33:27 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Volume volume-a621b7f6-d53b-4052-8bcd-baaaff39814f (a621b7f6-d53b-4052-8bcd-baaaff39814f): created successfully
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdfcec1-a7f2-4e46-aeac-dbdce3f0cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (8934609e-5af9-4e9d-88a1-5a8721cac2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:27 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" returned: 0 in 0.372s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-abdeed50-270b-4e75-ac9d-f4097b66e185 tempest-ProjectReaderTests-288098585 None] Created volume successfully.
Sep 09 13:33:27 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab
Sep 09 13:33:27 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-10942550-8f78-4cc0-ace8-0365de381d3a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "cinder-10942550-8f78-4cc0-ace8-0365de381d3a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-quobyte-10942550-8f78-4cc0-ace8-0365de381d3a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-10942550-8f78-4cc0-ace8-0365de381d3a" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef915f54-0790-4bb8-a758-662121eb3051]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a
Sep 09 13:33:27 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab" returned: 0 in 0.505s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 1073741824" returned: 0 in 0.607s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:27 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab
Sep 09 13:33:27 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:27 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:27 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a" returned: 0 in 0.420s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:27 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a
Sep 09 13:33:27 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:27 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:27 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40.ba757264-3b7d-4d5e-b06b-1654bc426eab" returned: 0 in 0.294s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-ba757264-3b7d-4d5e-b06b-1654bc426eab" released by "_delete_snapshot" :: held 1.705s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:28 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" released by "delete_snapshot" :: held 1.733s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.242s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f48253b-d3e4-4f09-be2a-1e077c6435c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efd3159-cf82-47ea-9108-b076340fa5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Creating offline snapshot 13e9e707-5743-48d6-88c0-bff6bd457092 of volume a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:28 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Volume volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 (6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9): created successfully
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efd3159-cf82-47ea-9108-b076340fa5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Flow 'volume_create_manager' (41a2c62e-7dba-4d3d-8faa-3f08963073b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e68f0-a226-4c7d-bee0-3441b8131d07]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9e4b6522-cccb-4e52-ab57-fa223e985a80 tempest-SnapshotDependencyTests-551806575 None] Created volume successfully.
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Created reservations ['88a33018-3a0c-4c94-b4c8-ed6bb991c6be', '6e59a68f-f069-49db-8349-0ade0a9ab9ec', 'a9e1224c-7bb2-44f9-90d8-b189be346465', '8da1a160-7360-44bc-beea-f582d25a9b80'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Delete snapshot completed successfully.
Sep 09 13:33:28 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-10942550-8f78-4cc0-ace8-0365de381d3a" returned: 0 in 0.289s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-665d58c7-0933-4e09-8d78-c4805bb16741 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-ba757264-3b7d-4d5e-b06b-1654bc426eab-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-10942550-8f78-4cc0-ace8-0365de381d3a" released by "delete_volume" :: held 0.772s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:28 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f
Sep 09 13:33:28 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Created reservations ['7aa9299e-0df3-400e-a6ba-19a23ca567dc', '1bf27e98-1d0f-4b2d-8452-c2ee738bbf2d', 'f8843e94-5435-401b-8700-8a7f2c6ef3ea', '54d85f32-47be-4954-8ee5-d3d9981b8137'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:28 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:28 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:28 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f" returned: 0 in 0.463s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:28 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 1G
Sep 09 13:33:28 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" acquired by "delete_volume" :: waited 0.032s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b42ce90-c120-48d8-853b-c62d49337906]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:28 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.381s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:28 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Deleted volume successfully.
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e6016b8d-d942-4dd8-bb6a-f00978d263da tempest-ProjectReaderTests-2033289555 None] Lock "cinder-10942550-8f78-4cc0-ace8-0365de381d3a-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:28 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40
Sep 09 13:33:28 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:29 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 1G" returned: 0 in 0.604s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a621b7f6-d53b-4052-8bcd-baaaff39814f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a621b7f6-d53b-4052-8bcd-baaaff39814f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092
Sep 09 13:33:29 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:29 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" returned: 0 in 0.511s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:29 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40
Sep 09 13:33:29 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (d18392ac-e2b5-4c39-97d9-65030f6db7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af40dae-5087-45f7-b058-c9e558022425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af40dae-5087-45f7-b058-c9e558022425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630692041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c909d6-779b-451a-9dee-a22f8686bd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:29Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a0c675-f4a8-449b-8d11-4313cda494c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a0c675-f4a8-449b-8d11-4313cda494c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb23656b-2e78-42df-87c2-ae8472ccd996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb23656b-2e78-42df-87c2-ae8472ccd996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c909d6-779b-451a-9dee-a22f8686bd98', 'volume_name': 'volume-22c909d6-779b-451a-9dee-a22f8686bd98', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b32b830-f88f-46fc-8fbe-18464f6e3f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b32b830-f88f-46fc-8fbe-18464f6e3f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffb891-f3e1-49bf-b024-c9284e1d9000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:29 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Volume 22c909d6-779b-451a-9dee-a22f8686bd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c909d6-779b-451a-9dee-a22f8686bd98', 'volume_size': 1}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:29 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a621b7f6-d53b-4052-8bcd-baaaff39814f -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092" returned: 0 in 0.303s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 is being set with open permissions: ugo+rw
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" returned: 0 in 0.268s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092
Sep 09 13:33:29 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40" released by "delete_volume" :: held 0.861s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Created reservations ['3d7af5a5-25f1-48d4-a87a-cb3558f13b8a', '12c61b44-cbff-4a45-b610-a902b8196ce0', '84b70cd8-5e08-44dd-ac74-12daa57d3b55', 'db9819c8-7125-48d8-b0ed-ed6389a4246b'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:29 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-16a26655-1f71-4239-8b31-f2920589b41c-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-16a26655-1f71-4239-8b31-f2920589b41c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:29 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "cinder-quobyte-16a26655-1f71-4239-8b31-f2920589b41c" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-16a26655-1f71-4239-8b31-f2920589b41c" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:29 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info
Sep 09 13:33:29 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6891bd-a7ff-4d44-bbd6-95c3b4c3d4d0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:29 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.297s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:29 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Deleted volume successfully.
Sep 09 13:33:29 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4365fc-cb45-4646-8bd5-8503a1e678da tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-7ca9f2b1-bda7-4a0e-bf17-5cb6a4b01d40-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:29 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c
Sep 09 13:33:29 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info" returned: 0 in 0.304s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info is being set with open permissions: ugo+rw
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:30 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info
Sep 09 13:33:30 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:30 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c
Sep 09 13:33:30 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.info" returned: 0 in 0.269s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.410s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Creating offline snapshot 297be1c8-d36a-464c-9827-7b2f80645b2d of volume 6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-636d7430-cac6-4657-b170-c08bde13cd41 tempest-ProjectReaderTests-288098585 None] Create snapshot completed successfully
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae155a-165e-4d89-af2f-8e613f456838]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:30 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-16a26655-1f71-4239-8b31-f2920589b41c" returned: 0 in 0.250s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-quobyte-16a26655-1f71-4239-8b31-f2920589b41c" released by "delete_volume" :: held 0.681s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Created reservations ['6d625723-589d-4dba-a924-ad8f93752517', 'f3ae68e0-90a5-468d-9a77-45a06eff368f', 'b3cdf62c-ae04-418f-a38a-bcc0d21423ae', '37a758ed-69aa-4422-bbd6-7018ec41e95e'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:30 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:30 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:30 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:30 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.399s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:30 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d 1G
Sep 09 13:33:30 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:30 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.262s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Deleted volume successfully.
Sep 09 13:33:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ff0c8a95-c2f7-4eb7-b9f4-a9c916070fb9 tempest-CinderUnicodeTest-1434607970 None] Lock "cinder-16a26655-1f71-4239-8b31-f2920589b41c-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-13e9e707-5743-48d6-88c0-bff6bd457092-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:31 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d 1G" returned: 0 in 0.522s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-13e9e707-5743-48d6-88c0-bff6bd457092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:31 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:31 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-13e9e707-5743-48d6-88c0-bff6bd457092" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-13e9e707-5743-48d6-88c0-bff6bd457092" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Deleting offline snapshot 13e9e707-5743-48d6-88c0-bff6bd457092 of volume a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] snapshot_file for this snap is: volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db3580-889f-4d2f-af33-f6bee196a548]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:31 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092
Sep 09 13:33:31 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:31 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.343s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:31 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d is being set with open permissions: ugo+rw
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:31 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:31 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:31 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092" returned: 0 in 0.442s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a621b7f6-d53b-4052-8bcd-baaaff39814f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e02d38-36e1-4273-aaf7-e7c11dacdb80]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:31 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:32 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info
Sep 09 13:33:32 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:32 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f
Sep 09 13:33:32 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:32 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info" returned: 0 in 0.296s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:32 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info is being set with open permissions: ugo+rw
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:32 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info
Sep 09 13:33:32 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:32 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f" returned: 0 in 0.488s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:32 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092
Sep 09 13:33:32 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:32 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.info" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.297s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630692041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c909d6-779b-451a-9dee-a22f8686bd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:29Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Creating volume 22c909d6-779b-451a-9dee-a22f8686bd98 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:32 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:32 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 1073741824
Sep 09 13:33:32 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-940fddf2-9e0a-48b8-90e9-6fc42f7ec35c tempest-SnapshotDependencyTests-551806575 None] Create snapshot completed successfully
Sep 09 13:33:32 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092" returned: 0 in 0.390s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:32 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092
Sep 09 13:33:32 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:33 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 1073741824" returned: 0 in 0.486s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:33 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f.13e9e707-5743-48d6-88c0-bff6bd457092" returned: 0 in 0.301s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-13e9e707-5743-48d6-88c0-bff6bd457092" released by "_delete_snapshot" :: held 1.744s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" released by "delete_snapshot" :: held 1.787s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:33 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98
Sep 09 13:33:33 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Created reservations ['9cdbfb06-bd23-4070-92eb-77000b5a91b5', 'ddbc95b0-0fe0-4578-9e61-5378c6e218b3', 'f1b144b1-c8a2-478f-8d58-b77f2fcb3dfd', 'dd46bfc6-1002-4725-8d7a-0b7436462271'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Delete snapshot completed successfully.
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-d5ada1f9-4db5-4d14-a6bd-b81187f6fea0 tempest-ProjectReaderTests-288098585 None] Lock "cinder-13e9e707-5743-48d6-88c0-bff6bd457092-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:33 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98" returned: 0 in 0.296s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffb891-f3e1-49bf-b024-c9284e1d9000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c909d6-779b-451a-9dee-a22f8686bd98', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c6a2f2-d448-4fc3-be1c-836fda997a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:33 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Volume volume-22c909d6-779b-451a-9dee-a22f8686bd98 (22c909d6-779b-451a-9dee-a22f8686bd98): created successfully
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c6a2f2-d448-4fc3-be1c-836fda997a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (d18392ac-e2b5-4c39-97d9-65030f6db7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-a621b7f6-d53b-4052-8bcd-baaaff39814f-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-fbfa0e3d-faec-4ab2-86c9-c815a0eb0aee tempest-ProjectReaderTests-2033289555 None] Created volume successfully.
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "cinder-a621b7f6-d53b-4052-8bcd-baaaff39814f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f9368-c330-4326-ad54-167a1cdfa549]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:33 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f
Sep 09 13:33:33 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:33 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Flow 'volume_create_manager' (0671b289-831a-4ef9-ad24-36c5dd6958d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c028a4a8-10e2-4739-8d5b-6284da7a1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c028a4a8-10e2-4739-8d5b-6284da7a1895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1941e5f-8f46-4bd7-810d-14ee423ddf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769f35a7818744e097c97de298d7b58e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=297be1c8-d36a-464c-9827-7b2f80645b2d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:34Z,use_quota=True,user_id='631b0bf7e0a346ae8c64782893f82507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d95bcf-f5e3-439e-be89-e16505b835d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d95bcf-f5e3-439e-be89-e16505b835d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88155b6-a5ae-41e5-b162-73b1a64667bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88155b6-a5ae-41e5-b162-73b1a64667bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1941e5f-8f46-4bd7-810d-14ee423ddf8a', 'volume_name': 'volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a', 'volume_size': 1, 'snapshot_id': '297be1c8-d36a-464c-9827-7b2f80645b2d'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d3025a-47ec-4ddf-ac16-a0f446bd23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d3025a-47ec-4ddf-ac16-a0f446bd23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0910c42e-0402-45c9-9952-6c8ccaec1cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Volume d1941e5f-8f46-4bd7-810d-14ee423ddf8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a', 'volume_size': 1, 'snapshot_id': '297be1c8-d36a-464c-9827-7b2f80645b2d'}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" by "_create_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Creating volume d1941e5f-8f46-4bd7-810d-14ee423ddf8a from snapshot 297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" by "_copy_volume_from_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] snapshot: 297be1c8-d36a-464c-9827-7b2f80645b2d, volume: d1941e5f-8f46-4bd7-810d-14ee423ddf8a,  {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:34 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f" returned: 0 in 0.460s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eccd6e0-d8b7-426c-8ef4-8f3d75b8ddd2]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:34 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f
Sep 09 13:33:34 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:34 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:34 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:34 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a621b7f6-d53b-4052-8bcd-baaaff39814f" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a621b7f6-d53b-4052-8bcd-baaaff39814f" released by "delete_volume" :: held 0.835s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Created reservations ['50d9e2cc-2c94-40de-bbae-90566fd51e20', 'b57b372b-91a6-477c-905f-08cdec40c2f8', 'f38f5200-1683-49ff-9fb7-9bf2745511ca', '3fe83db4-44de-438f-a91a-c72200847a55'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-22c909d6-779b-451a-9dee-a22f8686bd98-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:34 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "cinder-22c909d6-779b-451a-9dee-a22f8686bd98-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.602s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edcf45-4805-4d86-a470-c0fa435c000e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:34 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:34 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-quobyte-22c909d6-779b-451a-9dee-a22f8686bd98" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:34 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-22c909d6-779b-451a-9dee-a22f8686bd98" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d53cd2-23fb-4a23-b8ac-7784b6c8ee75]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:35 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:35 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:35 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:35 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Deleted volume successfully.
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1e1ce31d-2185-4ad2-8524-f1891f7b18c5 tempest-ProjectReaderTests-288098585 None] Lock "cinder-a621b7f6-d53b-4052-8bcd-baaaff39814f-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:35 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98
Sep 09 13:33:35 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:35 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.556s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Creating direct copy from snapshot {{(pid=87606) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.utils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Path /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a not found in is_blk_device check {{(pid=87606) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:35 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a
Sep 09 13:33:35 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:35 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (01c4301b-07e7-4611-96a0-98fb59bc0b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42361d8f-ab7c-46c8-9496-a2fcf5b2ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98" returned: 0 in 0.578s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42361d8f-ab7c-46c8-9496-a2fcf5b2ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154717843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4495741-a029-4033-8358-3c19f0fe695e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:36Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:35 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98
Sep 09 13:33:35 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4381e7e3-448d-46a6-8cb6-7a2c00270c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4381e7e3-448d-46a6-8cb6-7a2c00270c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74c1d13-48db-46a7-8a90-ac4bbc146914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74c1d13-48db-46a7-8a90-ac4bbc146914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4495741-a029-4033-8358-3c19f0fe695e', 'volume_name': 'volume-a4495741-a029-4033-8358-3c19f0fe695e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2009e3-ee43-40d6-861e-dcc5033c86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2009e3-ee43-40d6-861e-dcc5033c86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d98ece8-1e96-4a94-bf6b-c1e6de9c60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:35 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Volume a4495741-a029-4033-8358-3c19f0fe695e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4495741-a029-4033-8358-3c19f0fe695e', 'volume_size': 1}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:35 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-22c909d6-779b-451a-9dee-a22f8686bd98" returned: 0 in 0.307s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:35 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-22c909d6-779b-451a-9dee-a22f8686bd98" released by "delete_volume" :: held 0.955s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Created reservations ['e9ea03e1-b05e-4944-9ff8-15d00b163eeb', '3153cd50-5b16-454a-8384-24e942db8e8a', 'b4cf6172-aa87-4a92-b373-e98ba995b5a4', '66887155-ade9-450a-87e0-d23faa0abc85'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:36 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:36 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:36 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.645s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:36 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:36 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Deleted volume successfully.
Sep 09 13:33:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2a10406e-364d-4d59-811d-baba2764ff9b tempest-ProjectReaderTests-2033289555 None] Lock "cinder-22c909d6-779b-451a-9dee-a22f8686bd98-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (acfc42cc-5aa9-4397-a9f7-9b93959477dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167b860-0b82-4753-8988-febdb1def2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0167b860-0b82-4753-8988-febdb1def2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333746251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75463f5-a3e0-4e9d-bd3a-dca5b3985b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:39Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b272110-3d44-4a01-b78b-891555bc460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b272110-3d44-4a01-b78b-891555bc460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143904fe-0f4f-4ddf-8f7a-d4c9040e11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143904fe-0f4f-4ddf-8f7a-d4c9040e11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75463f5-a3e0-4e9d-bd3a-dca5b3985b90', 'volume_name': 'volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e5d26-13d4-4fca-bd44-6f11209a4116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e5d26-13d4-4fca-bd44-6f11209a4116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed4750-47f7-4404-a20b-28db24933af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:38 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Volume d75463f5-a3e0-4e9d-bd3a-dca5b3985b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90', 'volume_size': 1}
Sep 09 13:33:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:40 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" returned: 0 in 5.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:40 devstack cinder-volume[87606]: DEBUG cinder.image.image_utils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Image conversion details: src /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a {{(pid=87606) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 09 13:33:40 devstack cinder-volume[87606]: INFO cinder.image.image_utils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Converted 1024.00 MB image at 190.27 MB/s
Sep 09 13:33:40 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a is being set with open permissions: ugo+rw
Sep 09 13:33:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:40 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a
Sep 09 13:33:40 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:41 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" released by "_copy_volume_from_snapshot" :: held 6.918s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" released by "_create_volume_from_snapshot" :: held 6.996s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.021s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154717843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4495741-a029-4033-8358-3c19f0fe695e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:36Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Creating volume a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:41 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e 1073741824
Sep 09 13:33:41 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0910c42e-0402-45c9-9952-6c8ccaec1cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a', 'volume_size': 1, 'snapshot_id': '297be1c8-d36a-464c-9827-7b2f80645b2d'}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d53385-c89b-470b-b253-67a11c242720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Volume volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a (d1941e5f-8f46-4bd7-810d-14ee423ddf8a): created successfully
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d53385-c89b-470b-b253-67a11c242720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Flow 'volume_create_manager' (0671b289-831a-4ef9-ad24-36c5dd6958d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:41 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3e78f13d-26d5-4807-b9e7-7f8260227500 tempest-SnapshotDependencyTests-551806575 None] Created volume successfully.
Sep 09 13:33:41 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e 1073741824" returned: 0 in 0.453s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:41 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e
Sep 09 13:33:41 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:41 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333746251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75463f5-a3e0-4e9d-bd3a-dca5b3985b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484eb0ec5683468bab41031e3a60e0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:39Z,use_quota=True,user_id='ff497907766c4271847911dc08bae2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Creating volume d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-297be1c8-d36a-464c-9827-7b2f80645b2d-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:41 devstack sudo[107859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 1073741824
Sep 09 13:33:41 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d98ece8-1e96-4a94-bf6b-c1e6de9c60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4495741-a029-4033-8358-3c19f0fe695e', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee8011e-64c0-43d9-9e91-41259b8724c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-297be1c8-d36a-464c-9827-7b2f80645b2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:42 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Volume volume-a4495741-a029-4033-8358-3c19f0fe695e (a4495741-a029-4033-8358-3c19f0fe695e): created successfully
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee8011e-64c0-43d9-9e91-41259b8724c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (01c4301b-07e7-4611-96a0-98fb59bc0b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9f55c8eb-1b83-4c44-b113-b34504717505 tempest-ProjectReaderTests-288098585 None] Created volume successfully.
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Deleting offline snapshot 297be1c8-d36a-464c-9827-7b2f80645b2d of volume 6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] snapshot_file for this snap is: volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3796d49-3989-4a47-b426-b37633d9262c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:42 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:42 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:42 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:42 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.385s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 1073741824" returned: 0 in 0.537s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f511bb5-be3f-4c55-829e-43233b738690]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:42 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90
Sep 09 13:33:42 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:42 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:42 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:42 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.142s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed4750-47f7-4404-a20b-28db24933af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad193a-bb52-4356-bfd4-ec7e0e107106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Creating offline snapshot fd5676d6-e5f0-4136-ab38-ef495e7109f4 of volume a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:42 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Volume volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 (d75463f5-a3e0-4e9d-bd3a-dca5b3985b90): created successfully
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad193a-bb52-4356-bfd4-ec7e0e107106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Flow 'volume_create_manager' (acfc42cc-5aa9-4397-a9f7-9b93959477dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b5b26-0018-4b74-9f11-d7d5bb13fff0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6f4d5059-99c2-4991-8f4d-f46ce6af4653 tempest-ProjectReaderTests-2033289555 None] Created volume successfully.
Sep 09 13:33:43 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e
Sep 09 13:33:43 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:43 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.634s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:43 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:43 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:43 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e" returned: 0 in 0.431s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:43 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 1G
Sep 09 13:33:43 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (59e48aa8-a142-4101-b635-319591545376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3708c81f-d217-4733-a863-ea5861cc697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3708c81f-d217-4733-a863-ea5861cc697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92850933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f88d0f-8d26-41da-b952-0251933ceeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:43Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd12250-971e-4116-aee9-6d235d9cba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd12250-971e-4116-aee9-6d235d9cba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9993e27f-ce87-43e5-906b-d8843f888fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9993e27f-ce87-43e5-906b-d8843f888fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f88d0f-8d26-41da-b952-0251933ceeef', 'volume_name': 'volume-f4f88d0f-8d26-41da-b952-0251933ceeef', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2597373f-fc31-4880-8e19-b9bc74e0ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2597373f-fc31-4880-8e19-b9bc74e0ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d2dfa0-4a91-4d11-8ecb-b81b3b34f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:43 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Volume f4f88d0f-8d26-41da-b952-0251933ceeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f88d0f-8d26-41da-b952-0251933ceeef', 'volume_size': 1}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:43 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.398s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:43 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d
Sep 09 13:33:43 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:43 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 1G" returned: 0 in 0.444s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4495741-a029-4033-8358-3c19f0fe695e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:43 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4495741-a029-4033-8358-3c19f0fe695e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4
Sep 09 13:33:43 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:43 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9.297be1c8-d36a-464c-9827-7b2f80645b2d" returned: 0 in 0.269s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-297be1c8-d36a-464c-9827-7b2f80645b2d" released by "_delete_snapshot" :: held 1.814s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" released by "delete_snapshot" :: held 1.841s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Created reservations ['4d83068d-cd3a-4320-90be-ae475586b05e', 'ad061f3a-3594-4119-a35a-8a17256c69a2', '156cacee-c554-46ab-ac34-2e6222e41667', '6533df5f-ee3f-453d-9986-ead8a41634bd'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:43 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "cinder-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Acquiring lock "cinder-quobyte-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" acquired by "delete_volume" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Delete snapshot completed successfully.
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[48af44c7-2b64-4560-9d2c-8f4a474c3ac3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-64646bab-dfe5-4072-831a-014f5f1d6c38 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-297be1c8-d36a-464c-9827-7b2f80645b2d-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:44 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4495741-a029-4033-8358-3c19f0fe695e -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4" returned: 0 in 0.360s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 is being set with open permissions: ugo+rw
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:44 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4
Sep 09 13:33:44 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:44 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90
Sep 09 13:33:44 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5cc405-ee10-4c55-8a72-4e5d43d3ba69]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4" returned: 0 in 0.273s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:44 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info
Sep 09 13:33:44 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" returned: 0 in 0.463s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90
Sep 09 13:33:44 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.391s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info is being set with open permissions: ugo+rw
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9
Sep 09 13:33:44 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info
Sep 09 13:33:44 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "cinder-quobyte-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90" released by "delete_volume" :: held 0.782s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Created reservations ['85f047ae-1c90-4796-ac00-375a3e764473', '0057ce9e-97fe-4250-b7c3-22905db42bb3', '655c974c-05bf-4dc2-9e5d-b84c38b8defe', 'e021f700-113d-43ec-9ae2-8101e0dd20bb'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:44 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:44 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:44 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:44 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9" released by "delete_volume" :: held 0.754s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.info" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92850933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f88d0f-8d26-41da-b952-0251933ceeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:43Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Creating volume f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:45 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:45 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef 1073741824
Sep 09 13:33:45 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-74cf42e1-01b8-46c3-a7b7-d3eeea91ebc9 tempest-ProjectReaderTests-288098585 None] Create snapshot completed successfully
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Created reservations ['4658d8b5-138c-48af-b039-295b675c1347', '11b422c9-d43f-4678-90e9-03a83db2e0d7', '19f458b5-84eb-466b-88b6-b428c94f6373', '462b3fe9-ce45-4a8a-b7eb-d1b3feb8b667'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:45 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:45 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:45 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.353s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Deleted volume successfully.
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-74532c11-2b95-47a0-bd61-5e3fd07d6745 tempest-ProjectReaderTests-2033289555 None] Lock "cinder-d75463f5-a3e0-4e9d-bd3a-dca5b3985b90-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-d1941e5f-8f46-4bd7-810d-14ee423ddf8a-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-d1941e5f-8f46-4bd7-810d-14ee423ddf8a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" acquired by "delete_volume" :: waited 0.030s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:45 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.332s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Deleted volume successfully.
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3fe4db-4e9e-4363-be22-1782f9a9f7d7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-9dadf762-a80c-433d-aa63-4e93219e7914 tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-6a844fa4-8b3c-4d03-a3d6-619f06fdd5f9-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:45 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef 1073741824" returned: 0 in 0.619s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:45 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a
Sep 09 13:33:45 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:45 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef
Sep 09 13:33:45 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-fd5676d6-e5f0-4136-ab38-ef495e7109f4-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-fd5676d6-e5f0-4136-ab38-ef495e7109f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-fd5676d6-e5f0-4136-ab38-ef495e7109f4" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-fd5676d6-e5f0-4136-ab38-ef495e7109f4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:45 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Deleting offline snapshot fd5676d6-e5f0-4136-ab38-ef495e7109f4 of volume a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] snapshot_file for this snap is: volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:46 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef" returned: 0 in 0.337s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:46 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da0b87e-ac90-410f-bafc-778318e2c852]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" returned: 0 in 0.473s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d2dfa0-4a91-4d11-8ecb-b81b3b34f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f88d0f-8d26-41da-b952-0251933ceeef', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf5c3df-eb10-481f-928b-63d318ee828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:46 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a
Sep 09 13:33:46 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:46 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Volume volume-f4f88d0f-8d26-41da-b952-0251933ceeef (f4f88d0f-8d26-41da-b952-0251933ceeef): created successfully
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf5c3df-eb10-481f-928b-63d318ee828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (59e48aa8-a142-4101-b635-319591545376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:46 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c1d00f6d-a8e1-42a8-b509-c209bac6415d tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:33:46 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4
Sep 09 13:33:46 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:46 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" returned: 0 in 0.289s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-quobyte-d1941e5f-8f46-4bd7-810d-14ee423ddf8a" released by "delete_volume" :: held 0.813s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:46 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4" returned: 0 in 0.433s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4495741-a029-4033-8358-3c19f0fe695e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Created reservations ['5a41d678-2a6a-40ea-bed6-118ed4ed7776', '3949cc4d-fb69-47ed-9240-56ba6f198c5d', 'b9ddccfe-9dc7-4ef8-b8e6-108501f2a9bf', '941e07a1-3b22-40e0-ab1e-16eef0217b49'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3071421c-aa4e-4f30-bce4-1420a172e583]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:46 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e
Sep 09 13:33:46 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:46 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:46 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:47 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.386s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:47 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Deleted volume successfully.
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e" returned: 0 in 0.559s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-35dc2e0f-1702-463e-b13b-3d7698a8f06b tempest-SnapshotDependencyTests-551806575 None] Lock "cinder-d1941e5f-8f46-4bd7-810d-14ee423ddf8a-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:47 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4
Sep 09 13:33:47 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot a97b21db-cabc-40d2-8e70-5a51bc589d2f of volume f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f90933-e176-4d05-b6e7-95e69b616c4b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:47 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef
Sep 09 13:33:47 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:47 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4" returned: 0 in 0.502s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:47 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4
Sep 09 13:33:47 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:47 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef" returned: 0 in 0.450s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:47 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f 1G
Sep 09 13:33:47 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:47 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e.fd5676d6-e5f0-4136-ab38-ef495e7109f4" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-fd5676d6-e5f0-4136-ab38-ef495e7109f4" released by "_delete_snapshot" :: held 1.910s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" released by "delete_snapshot" :: held 1.939s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Created reservations ['9f63962a-42b4-4aab-a365-efc2b59e9353', 'c302e734-6fa1-403e-93aa-26f877ba3b7d', '454e4940-e767-4e67-bb12-0a49ba29e417', 'dc99c60c-d55b-47d6-9113-9d6a11b50911'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:48 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Delete snapshot completed successfully.
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-22a1624f-51a7-4dcd-875e-a7a096b97bda tempest-ProjectReaderTests-288098585 None] Lock "cinder-fd5676d6-e5f0-4136-ab38-ef495e7109f4-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-a4495741-a029-4033-8358-3c19f0fe695e-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "cinder-a4495741-a029-4033-8358-3c19f0fe695e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:48 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f 1G" returned: 0 in 0.556s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f88d0f-8d26-41da-b952-0251933ceeef -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2465b-6dad-4cc5-af8a-b3d19a08ce7e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:48 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f88d0f-8d26-41da-b952-0251933ceeef -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f
Sep 09 13:33:48 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:48 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e
Sep 09 13:33:48 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:48 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f88d0f-8d26-41da-b952-0251933ceeef -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:48 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f is being set with open permissions: ugo+rw
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:48 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f
Sep 09 13:33:48 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:48 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e" returned: 0 in 0.461s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:48 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e
Sep 09 13:33:48 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:48 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:48 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info
Sep 09 13:33:48 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:49 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-a4495741-a029-4033-8358-3c19f0fe695e" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4495741-a029-4033-8358-3c19f0fe695e" released by "delete_volume" :: held 0.796s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Created reservations ['898c4aa2-19ad-45e5-ab1f-4a9fadfcc080', '2f2d7dd7-5928-47a3-a9d3-874e80e640f9', '2e03aeb5-4653-4124-a1d6-2d9dcce448dc', '20f8da22-3c01-4485-9f00-510fd8693dcf'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:49 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:49 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info is being set with open permissions: ugo+rw
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:49 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:49 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:49 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info
Sep 09 13:33:49 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:49 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.306s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:49 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Deleted volume successfully.
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.info" returned: 0 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f25a8947-26a7-430c-aefe-bf3b75abfe42 tempest-ProjectReaderTests-288098585 None] Lock "cinder-a4495741-a029-4033-8358-3c19f0fe695e-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2981bcbc-3a60-4be2-8f16-65b956ee4f49 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (17372aa6-9573-430b-99c5-c83b961a176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e643390c-7367-430f-b7c3-2d78669ce0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e643390c-7367-430f-b7c3-2d78669ce0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4447127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b5323-cc0f-42a8-8336-bcdbcef26a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:50Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea7d4da-6a31-4a5b-ba59-49065b3e562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea7d4da-6a31-4a5b-ba59-49065b3e562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb83e1f-1dbe-43ff-b7c7-97ca2eefc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb83e1f-1dbe-43ff-b7c7-97ca2eefc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501b5323-cc0f-42a8-8336-bcdbcef26a2d', 'volume_name': 'volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66401455-6758-41bb-849d-d23240461b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66401455-6758-41bb-849d-d23240461b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7c7218-0310-40f1-8287-6b94dcb02883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:49 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Volume 501b5323-cc0f-42a8-8336-bcdbcef26a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d', 'volume_size': 1}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4447127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b5323-cc0f-42a8-8336-bcdbcef26a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:50Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Creating volume 501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:49 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:49 devstack sudo[108012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d 1073741824
Sep 09 13:33:49 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-a97b21db-cabc-40d2-8e70-5a51bc589d2f-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:50 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d 1073741824" returned: 0 in 0.424s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-a97b21db-cabc-40d2-8e70-5a51bc589d2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-a97b21db-cabc-40d2-8e70-5a51bc589d2f" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-a97b21db-cabc-40d2-8e70-5a51bc589d2f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot a97b21db-cabc-40d2-8e70-5a51bc589d2f of volume f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:50 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d
Sep 09 13:33:50 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd85a6f-6f0d-48a5-af49-819433bac516]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:50 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f
Sep 09 13:33:50 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:50 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7c7218-0310-40f1-8287-6b94dcb02883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d8bc0-8713-4e4a-970f-14ea5c692c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:50 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Volume volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d (501b5323-cc0f-42a8-8336-bcdbcef26a2d): created successfully
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d8bc0-8713-4e4a-970f-14ea5c692c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (17372aa6-9573-430b-99c5-c83b961a176f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:50 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f00d2d69-67d6-4175-a5b9-6e53436369a4 tempest-ProjectReaderTests-288098585 None] Created volume successfully.
Sep 09 13:33:50 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f" returned: 0 in 0.480s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:50 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4f88d0f-8d26-41da-b952-0251933ceeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94592d-25c1-43b9-9b04-3df91df89e89]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:51 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef
Sep 09 13:33:51 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:51 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef" returned: 0 in 0.373s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:51 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f
Sep 09 13:33:51 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:51 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f" returned: 0 in 0.405s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:51 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f
Sep 09 13:33:51 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:52 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef.a97b21db-cabc-40d2-8e70-5a51bc589d2f" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-a97b21db-cabc-40d2-8e70-5a51bc589d2f" released by "_delete_snapshot" :: held 1.665s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" released by "delete_snapshot" :: held 1.711s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Creating offline snapshot ab6b54bb-a481-4b43-ab07-ba8845fd7f95 of volume 501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[4679b656-f7e0-4267-bf3d-e4f53ac34719]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Created reservations ['d19dc50f-1e0b-4e75-a16a-10718b7b0d7d', '6aa4dbd0-bd84-427a-b39c-2bb7b9e7ff90', '2fe4324f-5fd5-42f8-903d-074ae0943539', 'e86d1cfe-d4f4-48c1-980d-c2905ecf7235'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:52 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-351e0d2c-2b66-4b90-b555-9270ac2e2018 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-a97b21db-cabc-40d2-8e70-5a51bc589d2f-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:52 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d
Sep 09 13:33:52 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-f4f88d0f-8d26-41da-b952-0251933ceeef-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "cinder-f4f88d0f-8d26-41da-b952-0251933ceeef-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:52 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d" returned: 0 in 0.509s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b88616-0927-46cc-836e-7f6fa0d10c67]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:52 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 1G
Sep 09 13:33:52 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:52 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef
Sep 09 13:33:52 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef" returned: 0 in 0.406s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:53 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 1G" returned: 0 in 0.447s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:53 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef
Sep 09 13:33:53 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95
Sep 09 13:33:53 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-f4f88d0f-8d26-41da-b952-0251933ceeef" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-f4f88d0f-8d26-41da-b952-0251933ceeef" released by "delete_volume" :: held 0.768s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Created reservations ['bfdf6b69-db6b-48bd-9e11-3be23a95071d', 'c56c46b3-45f7-471c-a7e0-7943b691f560', 'c31111da-ecfa-4dae-bc11-a2eccdb7e705', 'ecde2d91-18ad-4e0a-b59d-ce6798f81c18'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:53 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 is being set with open permissions: ugo+rw
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:53 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95
Sep 09 13:33:53 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:53 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:53 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:53 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info
Sep 09 13:33:53 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:53 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:33:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6cbd1400-0e34-4df9-8138-9ea243c798ad tempest-ProjectMemberTests-1168539348 None] Lock "cinder-f4f88d0f-8d26-41da-b952-0251933ceeef-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:54 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info" returned: 0 in 0.335s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:54 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info is being set with open permissions: ugo+rw
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:54 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info
Sep 09 13:33:54 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (16704f96-394f-485e-ab12-329242c35db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90a3837-3790-4995-8360-eab93c81ba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90a3837-3790-4995-8360-eab93c81ba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1767627423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec93a3-8b8c-4954-be36-eb6a0d260be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:54Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4934ec49-51cc-4232-8ec6-bd875b1d9552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4934ec49-51cc-4232-8ec6-bd875b1d9552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9952fd-dec4-46e0-819b-d5ccccc2bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9952fd-dec4-46e0-819b-d5ccccc2bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bec93a3-8b8c-4954-be36-eb6a0d260be5', 'volume_name': 'volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3c9ba2-c7be-4daf-8d02-e8c1b32e5edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3c9ba2-c7be-4daf-8d02-e8c1b32e5edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4238d0-023c-4a0a-b6c9-339a5821e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:54 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Volume 9bec93a3-8b8c-4954-be36-eb6a0d260be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5', 'volume_size': 1}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:54 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.info" returned: 0 in 0.290s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1767627423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec93a3-8b8c-4954-be36-eb6a0d260be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:54Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Creating volume 9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:54 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:54 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 1073741824
Sep 09 13:33:54 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ad22bc16-217d-4ab9-a485-1bc40036d5f2 tempest-ProjectReaderTests-288098585 None] Create snapshot completed successfully
Sep 09 13:33:54 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 1073741824" returned: 0 in 0.439s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:54 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5
Sep 09 13:33:54 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:55 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4238d0-023c-4a0a-b6c9-339a5821e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3625f31-d298-46ec-a562-b47c9579c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:55 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Volume volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 (9bec93a3-8b8c-4954-be36-eb6a0d260be5): created successfully
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3625f31-d298-46ec-a562-b47c9579c96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (16704f96-394f-485e-ab12-329242c35db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:55 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d22c0e84-844a-4e05-a689-a9344197b1f2 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-ab6b54bb-a481-4b43-ab07-ba8845fd7f95-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-ab6b54bb-a481-4b43-ab07-ba8845fd7f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-ab6b54bb-a481-4b43-ab07-ba8845fd7f95" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-ab6b54bb-a481-4b43-ab07-ba8845fd7f95" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Deleting offline snapshot ab6b54bb-a481-4b43-ab07-ba8845fd7f95 of volume 501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] snapshot_file for this snap is: volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f0b1f-0d69-4e38-9589-5687b674207a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:55 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95
Sep 09 13:33:55 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:55 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95" returned: 0 in 0.410s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0bfc0f-034b-43f9-84fd-fd4e0a888a52]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:55 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:56 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d
Sep 09 13:33:56 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:56 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d" returned: 0 in 0.392s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:56 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95
Sep 09 13:33:56 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot eda43252-1d7b-4661-8720-a310c9c89e21 of volume 9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a3631-b4cb-4615-b559-28bae98c076b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:56 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95" returned: 0 in 0.434s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:56 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5
Sep 09 13:33:56 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:56 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:56 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95
Sep 09 13:33:56 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:57 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d.ab6b54bb-a481-4b43-ab07-ba8845fd7f95" returned: 0 in 0.256s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:57 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5" returned: 0 in 0.415s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-ab6b54bb-a481-4b43-ab07-ba8845fd7f95" released by "_delete_snapshot" :: held 1.641s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" released by "delete_snapshot" :: held 1.668s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:57 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 1G
Sep 09 13:33:57 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Created reservations ['45faeb1e-fdfa-4658-985b-a0f0a4e290b4', 'e2c4c8f2-e895-4a56-bd67-650d2447264c', '5e498053-e8a0-420f-85a4-092046b6dd93', 'ee871f0e-63b3-418a-a703-d8953bac49be'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:57 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Delete snapshot completed successfully.
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1b28f46d-79bf-418b-b98b-b5af28134570 tempest-ProjectReaderTests-288098585 None] Lock "cinder-ab6b54bb-a481-4b43-ab07-ba8845fd7f95-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:57 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 1G" returned: 0 in 0.527s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-501b5323-cc0f-42a8-8336-bcdbcef26a2d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:57 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "cinder-501b5323-cc0f-42a8-8336-bcdbcef26a2d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:57 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6dde5-6413-4dfa-8e84-358f2108fa51]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:57 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d
Sep 09 13:33:57 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:57 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:57 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 is being set with open permissions: ugo+rw
Sep 09 13:33:57 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:57 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21
Sep 09 13:33:57 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:58 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d" returned: 0 in 0.446s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:58 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d
Sep 09 13:33:58 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:58 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21" returned: 0 in 0.299s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:58 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info
Sep 09 13:33:58 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:58 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-501b5323-cc0f-42a8-8336-bcdbcef26a2d" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-501b5323-cc0f-42a8-8336-bcdbcef26a2d" released by "delete_volume" :: held 0.795s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:58 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Created reservations ['2a74d531-5457-4696-a520-462d03f9f740', '22942b70-d9c7-4f19-ac54-e9b129d48d9f', '12caed6e-f023-42a9-a816-6bc6c10038a2', 'c5a59e16-a170-48ff-876d-d198cdfbfaed'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info" returned: 0 in 0.292s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info is being set with open permissions: ugo+rw
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:58 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info
Sep 09 13:33:58 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:58 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:33:58 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:58 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.info" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-69f23c89-b7f8-4a4a-a7ff-54c6be970a13 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:33:58 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:33:58 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Deleted volume successfully.
Sep 09 13:33:58 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e9b707bd-e6f2-4ea7-86cc-246d3b90e7a4 tempest-ProjectReaderTests-288098585 None] Lock "cinder-501b5323-cc0f-42a8-8336-bcdbcef26a2d-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (6d26fdd2-c004-4729-b75b-42edbd8d0947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f85e049-13c9-46fc-baeb-7b8ac505d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f85e049-13c9-46fc-baeb-7b8ac505d68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561110026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdcb3cf-dab2-47c8-b491-d59587e726cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:59Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86d954c-9684-441a-8b05-efb539ac05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86d954c-9684-441a-8b05-efb539ac05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d9936-53dd-4df4-8172-9aed636ca31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d9936-53dd-4df4-8172-9aed636ca31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdcb3cf-dab2-47c8-b491-d59587e726cd', 'volume_name': 'volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11773403-2135-4dd6-b7ef-f16c51150923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11773403-2135-4dd6-b7ef-f16c51150923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291cb00a-ff97-4fa6-98e0-641eb6766aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:33:59 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Volume 6bdcb3cf-dab2-47c8-b491-d59587e726cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd', 'volume_size': 1}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561110026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdcb3cf-dab2-47c8-b491-d59587e726cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:33:59Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Creating volume 6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:33:59 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:59 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd 1073741824
Sep 09 13:33:59 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:59 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd 1073741824" returned: 0 in 0.410s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-eda43252-1d7b-4661-8720-a310c9c89e21-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-eda43252-1d7b-4661-8720-a310c9c89e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-eda43252-1d7b-4661-8720-a310c9c89e21" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-eda43252-1d7b-4661-8720-a310c9c89e21" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot eda43252-1d7b-4661-8720-a310c9c89e21 of volume 9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:33:59 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd
Sep 09 13:33:59 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[788cc5b8-ac7f-4464-a79c-6fdec288b01f]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:33:59 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:33:59 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21
Sep 09 13:34:00 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:00 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291cb00a-ff97-4fa6-98e0-641eb6766aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56f6560-c649-4777-b3f3-98c46d545571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:00 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Volume volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd (6bdcb3cf-dab2-47c8-b491-d59587e726cd): created successfully
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56f6560-c649-4777-b3f3-98c46d545571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (6d26fdd2-c004-4729-b75b-42edbd8d0947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:00 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ec2a32ba-c0bc-4326-8073-acf8651c161e tempest-ProjectReaderTests-288098585 None] Created volume successfully.
Sep 09 13:34:00 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21" returned: 0 in 0.383s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[809583f2-ef05-4370-a4a4-300b6808e187]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:00 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5
Sep 09 13:34:00 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Creating offline snapshot c3f9e414-333d-44c0-84c9-02f22106ebc7 of volume 6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcffe1e9-47ad-4dc0-9a34-4f5a26ba2f0d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:00 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd
Sep 09 13:34:00 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:00 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5" returned: 0 in 0.393s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:00 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21
Sep 09 13:34:00 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:00 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:00 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:00 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 1G
Sep 09 13:34:00 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:01 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21" returned: 0 in 0.356s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:01 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21
Sep 09 13:34:01 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:01 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 1G" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:01 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7
Sep 09 13:34:01 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:01 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5.eda43252-1d7b-4661-8720-a310c9c89e21" returned: 0 in 0.266s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-eda43252-1d7b-4661-8720-a310c9c89e21" released by "_delete_snapshot" :: held 1.506s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" released by "delete_snapshot" :: held 1.540s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Created reservations ['37b076f1-1338-4fa9-8ce2-111a5674f2f1', '6e056779-8fe0-484e-afa4-12eda047ddd1', 'c3d84f16-7e0f-4e01-9255-d679cca32c64', '4510e88b-1539-4ff4-9815-58d500ad0814'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:01 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6f987bd9-1b63-49be-828e-dc50f041e60a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-eda43252-1d7b-4661-8720-a310c9c89e21-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:01 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7" returned: 0 in 0.298s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:01 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 is being set with open permissions: ugo+rw
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:01 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7
Sep 09 13:34:01 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:01 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7" returned: 0 in 0.240s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:01 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info
Sep 09 13:34:01 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-9bec93a3-8b8c-4954-be36-eb6a0d260be5-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:01 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-9bec93a3-8b8c-4954-be36-eb6a0d260be5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d5242-a072-4cca-bec2-1412a887b588]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:02 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:02 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info is being set with open permissions: ugo+rw
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:02 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info
Sep 09 13:34:02 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:02 devstack sudo[108193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5
Sep 09 13:34:02 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:02 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.info" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:02 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-04cdebf0-68e0-477f-bf30-27d514b941a6 tempest-ProjectReaderTests-288098585 None] Create snapshot completed successfully
Sep 09 13:34:02 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5" returned: 0 in 0.378s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:02 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5
Sep 09 13:34:02 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-c3f9e414-333d-44c0-84c9-02f22106ebc7-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-c3f9e414-333d-44c0-84c9-02f22106ebc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-c3f9e414-333d-44c0-84c9-02f22106ebc7" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-c3f9e414-333d-44c0-84c9-02f22106ebc7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Deleting offline snapshot c3f9e414-333d-44c0-84c9-02f22106ebc7 of volume 6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] snapshot_file for this snap is: volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d962a1a-02c4-4180-b242-a298d2133563]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:02 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9bec93a3-8b8c-4954-be36-eb6a0d260be5" returned: 0 in 0.259s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9bec93a3-8b8c-4954-be36-eb6a0d260be5" released by "delete_volume" :: held 0.698s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Created reservations ['20b56213-f74f-4ac0-a925-32d0b0198e89', '3e41afdb-3fce-4cd0-bb51-882df2f4243d', 'f75979c1-3c71-45d4-b941-0ae6847e2e29', 'c86ac119-14ec-4853-92de-f58481129000'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:02 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7
Sep 09 13:34:02 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:02 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:02 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:02 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:03 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7" returned: 0 in 0.380s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb56cfd-ad43-43e1-9ecd-ad1736bbebf3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:03 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:03 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fb3ca9d-3ce8-40a3-bf7b-631438553066 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-9bec93a3-8b8c-4954-be36-eb6a0d260be5-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:03 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd
Sep 09 13:34:03 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:03 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:03 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7
Sep 09 13:34:03 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (22286696-cf5d-41ce-b94a-cb3b1e8aae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa57dd3-dcc7-4a25-ab29-8c52c585626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa57dd3-dcc7-4a25-ab29-8c52c585626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816795829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:04Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2a1c06-8267-4c23-8d05-dacca14b579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2a1c06-8267-4c23-8d05-dacca14b579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d33536-52e8-4c5e-b960-659cb13bdbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d33536-52e8-4c5e-b960-659cb13bdbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc', 'volume_name': 'volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be27179c-c95f-4843-83de-8ae8f93f0539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be27179c-c95f-4843-83de-8ae8f93f0539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a78d72-f97a-4dfb-ba15-9bfd34a97a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:03 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Volume 9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc', 'volume_size': 1}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-816795829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:04Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Creating volume 9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:03 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:03 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc 1073741824
Sep 09 13:34:03 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:03 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7" returned: 0 in 0.333s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:03 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:03 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7
Sep 09 13:34:03 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:04 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd.c3f9e414-333d-44c0-84c9-02f22106ebc7" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-c3f9e414-333d-44c0-84c9-02f22106ebc7" released by "_delete_snapshot" :: held 1.460s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" released by "delete_snapshot" :: held 1.487s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:04 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc 1073741824" returned: 0 in 0.456s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:04 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc
Sep 09 13:34:04 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Created reservations ['153453ed-990c-4fb1-986f-40921be777e5', '8de7d34f-734c-43af-afe7-8b0e7b7cfc04', '2e277d95-86ff-40e0-a53f-ddd2c755c8e0', '18348ca7-5df4-41ed-9d80-9b86b0a1a3cc'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Delete snapshot completed successfully.
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ed4d4aae-67b0-4c4a-9851-9757dbe89685 tempest-ProjectReaderTests-288098585 None] Lock "cinder-c3f9e414-333d-44c0-84c9-02f22106ebc7-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:04 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a78d72-f97a-4dfb-ba15-9bfd34a97a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb89a4b-9711-4946-8f33-679ed9cac1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:04 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Volume volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc (9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc): created successfully
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb89a4b-9711-4946-8f33-679ed9cac1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (22286696-cf5d-41ce-b94a-cb3b1e8aae19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:04 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-a24e6a22-a42a-4548-96b1-c37b2bf4897d tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot 4d5192d1-b7af-41f7-b3ca-10afee121f2d of volume 9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-6bdcb3cf-dab2-47c8-b491-d59587e726cd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[792e8d6c-f1c8-4424-a8be-41328b4d9df1]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "cinder-6bdcb3cf-dab2-47c8-b491-d59587e726cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" acquired by "delete_volume" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9148f5-d659-47ee-a95c-0cb20b2ac813]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:04 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:04 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc
Sep 09 13:34:04 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd
Sep 09 13:34:05 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" returned: 0 in 0.378s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:05 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d 1G
Sep 09 13:34:05 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd" returned: 0 in 0.366s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:05 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd
Sep 09 13:34:05 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-6bdcb3cf-dab2-47c8-b491-d59587e726cd" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-6bdcb3cf-dab2-47c8-b491-d59587e726cd" released by "delete_volume" :: held 0.699s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Created reservations ['c40d62e9-84a5-4cf2-8942-84388a4684fb', '8df59cf3-52ed-4b62-8df8-cb1bf7b838f6', '092100f3-6f96-45c4-b9ea-87d5359942ea', '48432bf1-0acc-479f-bb1f-70c43d86a8e3'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:05 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d 1G" returned: 0 in 0.461s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:05 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d
Sep 09 13:34:05 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:05 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:05 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d" returned: 0 in 0.311s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d is being set with open permissions: ugo+rw
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:05 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:05 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Deleted volume successfully.
Sep 09 13:34:05 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d
Sep 09 13:34:05 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:05 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-2f98941b-7e7d-416f-9d79-fb54dfd3576e tempest-ProjectReaderTests-288098585 None] Lock "cinder-6bdcb3cf-dab2-47c8-b491-d59587e726cd-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:06 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d" returned: 0 in 0.269s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:06 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info
Sep 09 13:34:06 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (a705a2ff-7317-4204-ab4c-d1342aa33c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce71baaa-01ae-4287-8d52-00c264b2485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce71baaa-01ae-4287-8d52-00c264b2485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053335822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bd916c-8f19-4ea2-b446-5359bd530e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:06Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce84caa-a1b2-4d8c-a4cd-008e0d566c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce84caa-a1b2-4d8c-a4cd-008e0d566c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d164106-a24c-4fd9-8c53-9929f3642c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d164106-a24c-4fd9-8c53-9929f3642c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bd916c-8f19-4ea2-b446-5359bd530e83', 'volume_name': 'volume-e2bd916c-8f19-4ea2-b446-5359bd530e83', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2200e8-607f-4f5c-98c4-e6b604875939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2200e8-607f-4f5c-98c4-e6b604875939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa0a9d6-e528-4313-ba53-e66c43c5788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:06 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Volume e2bd916c-8f19-4ea2-b446-5359bd530e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bd916c-8f19-4ea2-b446-5359bd530e83', 'volume_size': 1}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:06 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:06 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info is being set with open permissions: ugo+rw
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:06 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info
Sep 09 13:34:06 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:06 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.info" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053335822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bd916c-8f19-4ea2-b446-5359bd530e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea4f87592f44dc8321ac01d3771c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:06Z,use_quota=True,user_id='11031e254e5848ed80c57614e0ab0c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Creating volume e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:06 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:06 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:06 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 1073741824
Sep 09 13:34:06 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:06 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-861bdd2e-528b-490a-b889-d8590c0b0c94 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:07 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 1073741824" returned: 0 in 0.401s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:07 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83
Sep 09 13:34:07 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:07 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa0a9d6-e528-4313-ba53-e66c43c5788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bd916c-8f19-4ea2-b446-5359bd530e83', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daf3477-2618-4eee-b372-814bf3034901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:07 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Volume volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 (e2bd916c-8f19-4ea2-b446-5359bd530e83): created successfully
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daf3477-2618-4eee-b372-814bf3034901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Flow 'volume_create_manager' (a705a2ff-7317-4204-ab4c-d1342aa33c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:07 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-d3727f76-1ee5-4996-a2e7-939f42cbba48 tempest-ProjectReaderTests-288098585 None] Created volume successfully.
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-4d5192d1-b7af-41f7-b3ca-10afee121f2d-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-4d5192d1-b7af-41f7-b3ca-10afee121f2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-4d5192d1-b7af-41f7-b3ca-10afee121f2d" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-4d5192d1-b7af-41f7-b3ca-10afee121f2d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot 4d5192d1-b7af-41f7-b3ca-10afee121f2d of volume 9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3f6c08-96f9-4754-8057-778f78da9e4b]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:07 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:08 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d
Sep 09 13:34:08 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:08 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d" returned: 0 in 0.351s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b1bdf6-47f0-4081-85ba-5b7d722192b3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:08 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc
Sep 09 13:34:08 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Creating offline snapshot a4e20f44-6e8a-431c-8444-687e084ab228 of volume e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a2b7c-1b95-4262-93ec-757356c3b4e7]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:08 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:08 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:08 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83
Sep 09 13:34:08 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:08 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d
Sep 09 13:34:08 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:09 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83" returned: 0 in 0.374s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:09 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 1G
Sep 09 13:34:09 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:09 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d" returned: 0 in 0.347s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:09 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d
Sep 09 13:34:09 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:09 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc.4d5192d1-b7af-41f7-b3ca-10afee121f2d" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-4d5192d1-b7af-41f7-b3ca-10afee121f2d" released by "_delete_snapshot" :: held 1.473s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" released by "delete_snapshot" :: held 1.496s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:09 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 1G" returned: 0 in 0.403s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:09 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228
Sep 09 13:34:09 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Created reservations ['21bb8dce-1ff8-49ac-9048-45cbc0c37e9f', '149f427a-2d01-41a7-8b43-a9e1cb006fc9', 'f33eaa3d-17f9-4084-9bf0-14f7b494e1c1', 'f2d1c8d3-e8c1-48ed-88a3-982b6f657b90'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:09 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6613e2f9-8cb1-485b-9968-78b3bfeb087a tempest-ProjectMemberTests-1168539348 None] Lock "cinder-4d5192d1-b7af-41f7-b3ca-10afee121f2d-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:09 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228" returned: 0 in 0.302s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:09 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 is being set with open permissions: ugo+rw
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:09 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228
Sep 09 13:34:09 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:09 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:09 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228" returned: 0 in 0.238s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:10 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info
Sep 09 13:34:10 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "cinder-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e58b23f-487d-4aaf-8015-84da898330c5]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:10 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info" returned: 0 in 0.266s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:10 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info is being set with open permissions: ugo+rw
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:10 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info
Sep 09 13:34:10 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:10 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc
Sep 09 13:34:10 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:10 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.info" returned: 0 in 0.254s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:10 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-c5bc5976-bf2f-4826-b6e9-b07d1dfc55ee tempest-ProjectReaderTests-288098585 None] Create snapshot completed successfully
Sep 09 13:34:10 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:10 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc
Sep 09 13:34:10 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-a4e20f44-6e8a-431c-8444-687e084ab228-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-a4e20f44-6e8a-431c-8444-687e084ab228-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-a4e20f44-6e8a-431c-8444-687e084ab228" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4e20f44-6e8a-431c-8444-687e084ab228" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Deleting offline snapshot a4e20f44-6e8a-431c-8444-687e084ab228 of volume e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] snapshot_file for this snap is: volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ee677-113e-4f75-9a9c-24e8af236da5]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:10 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc" released by "delete_volume" :: held 0.709s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:10 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Created reservations ['3ea80dd7-4cd9-4b9f-a59a-9173806c287c', '02e76823-8659-4e83-a727-deb45332ab3f', '42124862-6942-4496-ab46-35bdff94e81e', '1015cc2b-6c39-43ba-87d6-353036e8ecc4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:10 devstack sudo[108331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228
Sep 09 13:34:10 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:11 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:11 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:11 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228" returned: 0 in 0.403s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bd916c-8f19-4ea2-b446-5359bd530e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[352bd504-4620-4d8a-a409-c9c7ca862dda]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:11 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:11 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-e2794bbb-485a-44db-af3a-149b8e45977f tempest-ProjectMemberTests-1168539348 None] Lock "cinder-9246c9e7-55ef-4d8a-9b31-d005ae3c0dfc-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:11 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83
Sep 09 13:34:11 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:11 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83" returned: 0 in 0.400s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:11 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228
Sep 09 13:34:11 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (d17ebda8-570c-4369-9e3a-64adb96f8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215022b1-e0ce-4661-85b9-605310d91035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215022b1-e0ce-4661-85b9-605310d91035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784023837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:12Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db6fac2-e1ce-4778-8844-92aa8d926efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db6fac2-e1ce-4778-8844-92aa8d926efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28bb8be-2abd-439d-bca4-b27afd6b78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28bb8be-2abd-439d-bca4-b27afd6b78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd', 'volume_name': 'volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9daa5c-8a71-4422-b050-3301894f1b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9daa5c-8a71-4422-b050-3301894f1b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5a96c2-7ac4-4845-b1f6-e80382e027c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:11 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Volume 2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd', 'volume_size': 1}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784023837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:12Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Creating volume 2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:11 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:11 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:11 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd 1073741824
Sep 09 13:34:11 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:12 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228" returned: 0 in 0.346s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:12 devstack sudo[108352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228
Sep 09 13:34:12 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:12 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd 1073741824" returned: 0 in 0.424s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:12 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83.a4e20f44-6e8a-431c-8444-687e084ab228" returned: 0 in 0.274s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:12 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd
Sep 09 13:34:12 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-a4e20f44-6e8a-431c-8444-687e084ab228" released by "_delete_snapshot" :: held 1.532s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" released by "delete_snapshot" :: held 1.555s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Created reservations ['414f40dc-2abc-4bcc-8cc8-1ca5b1abb201', 'f8d0033d-73db-48bd-b79a-72842f859f4d', '4da10da8-b8cf-4ff6-a207-0df0de8fd46c', '41cfa850-dfa3-4723-8d01-90b6aee39294'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Delete snapshot completed successfully.
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-854c4def-7a67-4bab-83b4-1f71ae153b2f tempest-ProjectReaderTests-288098585 None] Lock "cinder-a4e20f44-6e8a-431c-8444-687e084ab228-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:12 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" returned: 0 in 0.258s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5a96c2-7ac4-4845-b1f6-e80382e027c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9a0b11-1996-445f-888b-5582c6e8e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:12 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Volume volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd (2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd): created successfully
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9a0b11-1996-445f-888b-5582c6e8e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (d17ebda8-570c-4369-9e3a-64adb96f8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:12 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1b438378-2aaa-4aff-a664-7c82031a33d2 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot 14bb8818-433a-410d-a213-9a990e3811bd of volume 2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-e2bd916c-8f19-4ea2-b446-5359bd530e83-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[522cfe3a-4de3-4fff-8e7a-37c11c1184a6]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "cinder-e2bd916c-8f19-4ea2-b446-5359bd530e83-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:12 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Acquiring lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[0166829b-3f34-4ed3-bd2a-23fc9a2a332d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:13 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd
Sep 09 13:34:13 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:13 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83
Sep 09 13:34:13 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:13 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" returned: 0 in 0.394s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:13 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd 1G
Sep 09 13:34:13 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:13 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:13 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83
Sep 09 13:34:13 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:13 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-e2bd916c-8f19-4ea2-b446-5359bd530e83" returned: 0 in 0.281s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "cinder-quobyte-e2bd916c-8f19-4ea2-b446-5359bd530e83" released by "delete_volume" :: held 0.699s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:13 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd 1G" returned: 0 in 0.416s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:13 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd
Sep 09 13:34:13 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Created reservations ['7ae2991b-eb29-44c3-8682-c57cc0626d51', 'f8ff1bfe-130d-4ba6-89d1-afe90414d261', 'c2e3e3ab-955c-4ea0-b22a-eaac8a879d93', '691bf0f7-7c63-49f6-a664-df905ba9f9b5'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:13 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:13 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:13 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:14 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd" returned: 0 in 0.328s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:14 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd is being set with open permissions: ugo+rw
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:14 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd
Sep 09 13:34:14 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:14 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.269s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Deleted volume successfully.
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-052e0313-53ad-4f35-b0eb-f2d0bbed812b tempest-ProjectReaderTests-288098585 None] Lock "cinder-e2bd916c-8f19-4ea2-b446-5359bd530e83-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:14 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:14 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info
Sep 09 13:34:14 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:14 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:14 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info is being set with open permissions: ugo+rw
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:14 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info
Sep 09 13:34:14 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:14 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.info" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:14 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:14 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0af492ad-5a92-4b79-839e-b5d3ce310dff tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-14bb8818-433a-410d-a213-9a990e3811bd-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-14bb8818-433a-410d-a213-9a990e3811bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-14bb8818-433a-410d-a213-9a990e3811bd" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-14bb8818-433a-410d-a213-9a990e3811bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot 14bb8818-433a-410d-a213-9a990e3811bd of volume 2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b02b7c-0664-4d3a-b94f-b8ca6768c047]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:15 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd
Sep 09 13:34:15 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:15 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd" returned: 0 in 0.397s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cf58e3-667d-43f3-bb0a-c165e3a066cc]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:15 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd
Sep 09 13:34:15 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:15 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:15 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:15 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd
Sep 09 13:34:15 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:16 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd" returned: 0 in 0.363s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:16 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd
Sep 09 13:34:16 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:16 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd.14bb8818-433a-410d-a213-9a990e3811bd" returned: 0 in 0.271s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-14bb8818-433a-410d-a213-9a990e3811bd" released by "_delete_snapshot" :: held 1.513s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" released by "delete_snapshot" :: held 1.535s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Created reservations ['889f97ab-8260-484e-976b-93a77befbd84', 'db39d5a3-fad6-4756-a427-2cf99cce03c4', '37b608f4-3bd7-4601-af90-71e6996b6312', '3152647c-9019-43ec-bcc3-1f8c229ec1fe'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:16 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:16 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7b8f0ceb-1195-4d2b-9a87-a821d216d509 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-14bb8818-433a-410d-a213-9a990e3811bd-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "cinder-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b9ed8-6c58-446d-a6e5-07ce6297327d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:17 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd
Sep 09 13:34:17 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:17 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" returned: 0 in 0.398s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:17 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd
Sep 09 13:34:17 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Flow 'volume_create_manager' (2f6874ec-08db-457e-acc7-5d5a40102877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb0469-5544-4f5a-bff7-0546bbc80ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb0469-5544-4f5a-bff7-0546bbc80ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667076150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8608bccc-d092-44d7-875a-efe42b6d644b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34b76f228a546da8a5a3e92fb73d6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:18Z,use_quota=True,user_id='b7fd4374f77d4ca9a5ba9a33d9130ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486f183-7403-4f64-90e2-ec19528a00e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486f183-7403-4f64-90e2-ec19528a00e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187cd4d9-908c-4e9d-98ec-5f48f578865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187cd4d9-908c-4e9d-98ec-5f48f578865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8608bccc-d092-44d7-875a-efe42b6d644b', 'volume_name': 'volume-8608bccc-d092-44d7-875a-efe42b6d644b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b930d30e-80f7-4d68-a585-bff6f9a584b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b930d30e-80f7-4d68-a585-bff6f9a584b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c109f5e3-ea85-4198-b39d-552e654ec3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:17 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Volume 8608bccc-d092-44d7-875a-efe42b6d644b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8608bccc-d092-44d7-875a-efe42b6d644b', 'volume_size': 1}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667076150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8608bccc-d092-44d7-875a-efe42b6d644b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34b76f228a546da8a5a3e92fb73d6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:18Z,use_quota=True,user_id='b7fd4374f77d4ca9a5ba9a33d9130ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Creating volume 8608bccc-d092-44d7-875a-efe42b6d644b {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:17 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:17 devstack sudo[108424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b 1073741824
Sep 09 13:34:17 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:17 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" returned: 0 in 0.259s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:17 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd" released by "delete_volume" :: held 0.716s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Created reservations ['ebdd8703-11f8-4ab1-a3aa-ce8221652fb1', 'fc60a150-5691-4475-ab1f-6fff4a6ab266', '7f2769ab-c598-4818-90ff-f4cd849a6d54', 'e15e61d9-bd20-41a3-89be-2f003d0aafe2'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:18 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:18 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:18 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b 1073741824" returned: 0 in 0.458s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:18 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5bfc1b18-4ba4-4ed7-871d-11b873370b3d tempest-ProjectMemberTests-1168539348 None] Lock "cinder-2b83bbab-4c27-42bc-8dc8-f9b3ac9ad8cd-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:18 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b
Sep 09 13:34:18 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:18 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b" returned: 0 in 0.276s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c109f5e3-ea85-4198-b39d-552e654ec3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8608bccc-d092-44d7-875a-efe42b6d644b', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a685b-2ff9-4e71-8c50-4fd92c696494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Volume volume-8608bccc-d092-44d7-875a-efe42b6d644b (8608bccc-d092-44d7-875a-efe42b6d644b): created successfully
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a685b-2ff9-4e71-8c50-4fd92c696494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Flow 'volume_create_manager' (2f6874ec-08db-457e-acc7-5d5a40102877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:18 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ce8609e2-bdff-4388-b645-554ab761b0a4 tempest-ProjectReaderTests-1776956736 None] Created volume successfully.
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (2b1ad758-2974-43ca-a2b4-68c8116b231e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc915d-b8d9-4f46-bfcc-edc01e68e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc915d-b8d9-4f46-bfcc-edc01e68e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372777009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5af31b3-9889-41e1-8dde-1f4acbcb27a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:19Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdd3013-84dc-4687-aae4-ba75bb064f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdd3013-84dc-4687-aae4-ba75bb064f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961ee38a-6ef5-4b4d-a473-3ca61b0c7e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961ee38a-6ef5-4b4d-a473-3ca61b0c7e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5af31b3-9889-41e1-8dde-1f4acbcb27a5', 'volume_name': 'volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82bce52-8ecd-4ed5-8099-e469bd7a1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82bce52-8ecd-4ed5-8099-e469bd7a1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a742d688-65e2-4301-8546-4dae156e3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:18 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Volume c5af31b3-9889-41e1-8dde-1f4acbcb27a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5', 'volume_size': 1}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372777009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5af31b3-9889-41e1-8dde-1f4acbcb27a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:19Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Creating volume c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:18 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:18 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:18 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 1073741824
Sep 09 13:34:18 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:19 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 1073741824" returned: 0 in 0.413s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:19 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5
Sep 09 13:34:19 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:19 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" returned: 0 in 0.270s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:DELETE=23,cinder:SELECT=215,cinder:UPDATE=264,cinder:INSERT=70 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a742d688-65e2-4301-8546-4dae156e3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677acea3-af29-40e8-8e10-ba62515161ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=195,cinder:UPDATE=264,cinder:INSERT=70,cinder:DELETE=22 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:34:19 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Volume volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 (c5af31b3-9889-41e1-8dde-1f4acbcb27a5): created successfully
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677acea3-af29-40e8-8e10-ba62515161ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:19 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (2b1ad758-2974-43ca-a2b4-68c8116b231e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:19 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-81cde4b4-dab1-467c-8304-f937c48197bc tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "cinder-8608bccc-d092-44d7-875a-efe42b6d644b-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot 4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd of volume c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-8608bccc-d092-44d7-875a-efe42b6d644b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3323e7-ec5a-47ca-a7b2-112a997d3d11]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "cinder-quobyte-8608bccc-d092-44d7-875a-efe42b6d644b" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-quobyte-8608bccc-d092-44d7-875a-efe42b6d644b" acquired by "delete_volume" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430c3cd-1e1f-4944-b5f5-9b3a1faf0d01]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:20 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5
Sep 09 13:34:20 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:20 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b
Sep 09 13:34:20 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:20 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:20 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd 1G
Sep 09 13:34:20 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:20 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b" returned: 0 in 0.376s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:20 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b
Sep 09 13:34:20 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:20 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-8608bccc-d092-44d7-875a-efe42b6d644b" returned: 0 in 0.272s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:20 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd 1G" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-quobyte-8608bccc-d092-44d7-875a-efe42b6d644b" released by "delete_volume" :: held 0.699s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:20 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd
Sep 09 13:34:20 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Created reservations ['99e3eec3-50e6-4dd6-9b66-3c538704ca09', '2bad7868-31b6-4832-80f3-997ecdefa9e2', 'c618658c-1a83-407b-9db4-42120b5785d1', '0879932c-5929-4d47-88e6-65e81cb2af17'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:20 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:21 devstack sudo[108465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:21 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:21 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" returned: 0 in 0.311s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:21 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd is being set with open permissions: ugo+rw
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:21 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd
Sep 09 13:34:21 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:21 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.263s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:21 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Deleted volume successfully.
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-7f5afa4c-8ba6-4a59-867f-89a74cf94865 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-8608bccc-d092-44d7-875a-efe42b6d644b-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:21 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:21 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info
Sep 09 13:34:21 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:21 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Flow 'volume_create_manager' (7559cc15-fdc1-4f75-91ff-868759d4d6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504007ae-7fb5-4a89-aec1-5b08c0a51da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info" returned: 0 in 0.280s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:21 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info is being set with open permissions: ugo+rw
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504007ae-7fb5-4a89-aec1-5b08c0a51da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111239584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b88827e-95b1-4165-ac83-0f1f4ffe6fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34b76f228a546da8a5a3e92fb73d6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:22Z,use_quota=True,user_id='b7fd4374f77d4ca9a5ba9a33d9130ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:21 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info
Sep 09 13:34:21 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33927993-65a9-4c5f-b22c-c24ce553d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33927993-65a9-4c5f-b22c-c24ce553d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e656c60c-4348-44da-836c-a1499e34501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e656c60c-4348-44da-836c-a1499e34501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b88827e-95b1-4165-ac83-0f1f4ffe6fcb', 'volume_name': 'volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19bf4b1-4e19-41e1-bce3-b492e35e3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19bf4b1-4e19-41e1-bce3-b492e35e3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db59d7d1-f2a6-4500-802c-ea70b44d2dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:21 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Volume 0b88827e-95b1-4165-ac83-0f1f4ffe6fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb', 'volume_size': 1}
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:21 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:21 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.info" returned: 0 in 0.257s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111239584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b88827e-95b1-4165-ac83-0f1f4ffe6fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34b76f228a546da8a5a3e92fb73d6e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:22Z,use_quota=True,user_id='b7fd4374f77d4ca9a5ba9a33d9130ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Creating volume 0b88827e-95b1-4165-ac83-0f1f4ffe6fcb {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:22 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:22 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb 1073741824
Sep 09 13:34:22 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-22d037d1-439e-4478-bc1a-5567d066bf31 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot 4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd of volume c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e4a915-3871-4855-b297-56ff07b6dfd0]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:22 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd
Sep 09 13:34:22 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:22 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb 1073741824" returned: 0 in 0.440s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:22 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb
Sep 09 13:34:22 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:22 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" returned: 0 in 0.391s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6162a9-d13d-42a5-9a33-91fe51d8975c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:22 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" returned: 0 in 0.267s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db59d7d1-f2a6-4500-802c-ea70b44d2dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3504347-af8c-4c05-8a82-62c600b83f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:22 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Volume volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb (0b88827e-95b1-4165-ac83-0f1f4ffe6fcb): created successfully
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3504347-af8c-4c05-8a82-62c600b83f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:22 devstack sudo[108493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5
Sep 09 13:34:22 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:22 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Flow 'volume_create_manager' (7559cc15-fdc1-4f75-91ff-868759d4d6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:22 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-aa9b552e-f294-42cc-981f-ff6b22350835 tempest-ProjectReaderTests-1776956736 None] Created volume successfully.
Sep 09 13:34:23 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" returned: 0 in 0.363s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:23 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd
Sep 09 13:34:23 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:23 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" returned: 0 in 0.321s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:23 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd
Sep 09 13:34:23 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:23 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5.4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" returned: 0 in 0.254s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd" released by "_delete_snapshot" :: held 1.418s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" released by "delete_snapshot" :: held 1.452s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Created reservations ['1c59af60-be9e-4f49-86ae-65bec2b5bb85', '187765b1-260c-49a8-b352-eb7344f7b0b7', 'e5ad021e-b004-40da-a3c9-00d9e418af5d', '6df200ff-8bdf-48cb-9797-5ae57041d296'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:23 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-6fa0bd36-b812-46ab-84a7-0c9b46f6c576 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-4ad9e230-f8ab-4315-b7fe-a29b5d7cf2fd-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "cinder-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "cinder-quobyte-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-quobyte-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734e3a7-876e-4acc-b27e-3ef5a5c8746c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:23 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:24 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb
Sep 09 13:34:24 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:24 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:24 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb
Sep 09 13:34:24 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-c5af31b3-9889-41e1-8dde-1f4acbcb27a5-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "cinder-c5af31b3-9889-41e1-8dde-1f4acbcb27a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fbea52-bd55-4e1f-846a-88ef80e9381a]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:24 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-quobyte-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb" released by "delete_volume" :: held 0.664s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:24 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5
Sep 09 13:34:24 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Created reservations ['8f96d228-c799-4f42-9fc7-7084ef799688', '85bd639b-7a0e-4ce7-b51d-6d25c0281966', '24b1e195-7c67-456a-8d08-53151d814f64', '781b085b-9383-4bcf-90e9-9e1c04bfcfc5'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:24 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:24 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:24 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" returned: 0 in 0.413s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:24 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5
Sep 09 13:34:24 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:24 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.264s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:24 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Deleted volume successfully.
Sep 09 13:34:24 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-40496f00-c529-4457-af53-eb3efae1a1c3 tempest-ProjectReaderTests-1776956736 None] Lock "cinder-0b88827e-95b1-4165-ac83-0f1f4ffe6fcb-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:25 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" returned: 0 in 0.279s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c5af31b3-9889-41e1-8dde-1f4acbcb27a5" released by "delete_volume" :: held 0.754s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Created reservations ['4dfd0467-b41f-4cb4-8b21-b0b346d3d518', 'fa3456dd-f876-48fb-8d64-1c7190486991', '40d518d8-1add-456c-aff2-1a222a1fd84b', '4e6b63b1-93f4-4bc0-bc51-a13ed488d8e7'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:25 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:25 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:25 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:25 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:25 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.283s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:25 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-0ab579a9-bed3-41b3-9068-76d4bc5161ae tempest-ProjectMemberTests-1168539348 None] Lock "cinder-c5af31b3-9889-41e1-8dde-1f4acbcb27a5-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:25 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.330s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:34:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (86c04b6d-49d5-4f60-ae31-803cbd3702e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798c6242-3b84-4f57-8f33-904b2b077b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798c6242-3b84-4f57-8f33-904b2b077b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635210317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda53ec-a132-409d-b8cc-c4bf67eaa953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:26Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f0acd7-b94b-45d1-b9c2-0a5dd420b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f0acd7-b94b-45d1-b9c2-0a5dd420b21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb8dd60-00e6-4eb4-a66c-02463e92d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb8dd60-00e6-4eb4-a66c-02463e92d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efda53ec-a132-409d-b8cc-c4bf67eaa953', 'volume_name': 'volume-efda53ec-a132-409d-b8cc-c4bf67eaa953', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e53280-f506-45fe-9814-91c313924e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e53280-f506-45fe-9814-91c313924e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2760cf44-d84e-405e-97fa-74fd29fb3999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:26 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Volume efda53ec-a132-409d-b8cc-c4bf67eaa953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efda53ec-a132-409d-b8cc-c4bf67eaa953', 'volume_size': 1}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635210317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda53ec-a132-409d-b8cc-c4bf67eaa953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:26Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Creating volume efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:26 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:26 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 1073741824
Sep 09 13:34:26 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:26 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 1073741824" returned: 0 in 0.515s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:26 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953
Sep 09 13:34:26 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:26 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953" returned: 0 in 0.260s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:26 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2760cf44-d84e-405e-97fa-74fd29fb3999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efda53ec-a132-409d-b8cc-c4bf67eaa953', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dadf636-420d-4971-bd9d-aa08b3754389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:27 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Volume volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 (efda53ec-a132-409d-b8cc-c4bf67eaa953): created successfully
Sep 09 13:34:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dadf636-420d-4971-bd9d-aa08b3754389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:27 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (86c04b6d-49d5-4f60-ae31-803cbd3702e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:27 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1c62b02e-3594-4ac3-b6ac-fc245ff61ab5 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot 79429c81-3a8e-49e5-b6cd-5937cbf49089 of volume efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6794e2-913a-4d7c-84e8-7e1edf644878]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:28 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953
Sep 09 13:34:28 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:28 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953" returned: 0 in 0.384s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:28 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:28 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 1G
Sep 09 13:34:28 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:29 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 1G" returned: 0 in 0.422s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:29 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089
Sep 09 13:34:29 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:29 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089" returned: 0 in 0.311s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:29 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 is being set with open permissions: ugo+rw
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:29 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089
Sep 09 13:34:29 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:29 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:29 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:29 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info
Sep 09 13:34:29 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:30 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info" returned: 0 in 0.284s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:30 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info is being set with open permissions: ugo+rw
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:30 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info
Sep 09 13:34:30 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:30 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.info" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:30 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-8c4a244f-c5fd-4440-9d00-072efd6afed4 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-79429c81-3a8e-49e5-b6cd-5937cbf49089-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-79429c81-3a8e-49e5-b6cd-5937cbf49089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-79429c81-3a8e-49e5-b6cd-5937cbf49089" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-79429c81-3a8e-49e5-b6cd-5937cbf49089" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot 79429c81-3a8e-49e5-b6cd-5937cbf49089 of volume efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d11568-6a38-467d-9c91-5d83b2ff5090]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:30 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089
Sep 09 13:34:30 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:30 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089" returned: 0 in 0.362s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efda53ec-a132-409d-b8cc-c4bf67eaa953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[680836b4-4458-4699-93c1-c02bdbe67b43]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:30 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:31 devstack sudo[108610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953
Sep 09 13:34:31 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:31 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953" returned: 0 in 0.370s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:31 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089
Sep 09 13:34:31 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:31 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089" returned: 0 in 0.336s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:31 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089
Sep 09 13:34:31 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:31 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953.79429c81-3a8e-49e5-b6cd-5937cbf49089" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-79429c81-3a8e-49e5-b6cd-5937cbf49089" released by "_delete_snapshot" :: held 1.402s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" released by "delete_snapshot" :: held 1.428s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:31 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Created reservations ['827e5219-1f1a-4f37-b862-366550845ad2', '72aa2094-02de-4043-9f96-5cdc76009355', '6a0c5e91-bbb9-429f-93f4-54267a60740e', '85e28c81-2333-4278-9ce1-a6b40fecae03'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:32 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-23c568b7-a60a-483e-9a87-818cfe0f30ec tempest-ProjectMemberTests-1168539348 None] Lock "cinder-79429c81-3a8e-49e5-b6cd-5937cbf49089-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-efda53ec-a132-409d-b8cc-c4bf67eaa953-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-efda53ec-a132-409d-b8cc-c4bf67eaa953-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[981e5ce9-258c-4082-ad9d-449e6f1d8c05]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:32 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:32 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953
Sep 09 13:34:32 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:33 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:33 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953
Sep 09 13:34:33 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:33 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-efda53ec-a132-409d-b8cc-c4bf67eaa953" returned: 0 in 0.240s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-efda53ec-a132-409d-b8cc-c4bf67eaa953" released by "delete_volume" :: held 0.649s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Created reservations ['dca70a00-c99f-4aed-a40c-3e59d1892829', '3018f2df-ae9a-4951-83eb-e02134c0b961', '1a24bfbb-9bf4-436a-8dfd-6734cafd4b0e', '173d3c0f-460b-43e8-910c-75f7f9e6e1a4'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:33 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:33 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:33 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.249s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:33 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:33 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-5d871184-3524-4622-a306-6e18b2432771 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-efda53ec-a132-409d-b8cc-c4bf67eaa953-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (1301960d-7b20-4661-8bfa-0495b4bee232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17aa2475-651b-465e-b927-e315779bb36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17aa2475-651b-465e-b927-e315779bb36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449659839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765c514d-3c56-48bd-b059-81ad0db1e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:34Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626d022-d2b2-4b8a-ad0f-af5760a4ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626d022-d2b2-4b8a-ad0f-af5760a4ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe5bcfe-972b-42f1-a7b7-d763b654ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe5bcfe-972b-42f1-a7b7-d763b654ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765c514d-3c56-48bd-b059-81ad0db1e819', 'volume_name': 'volume-765c514d-3c56-48bd-b059-81ad0db1e819', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2ab804-3155-4905-a610-2f3f4927f3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2ab804-3155-4905-a610-2f3f4927f3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d179cca5-d1f6-4bb3-85a7-a0631627d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Volume 765c514d-3c56-48bd-b059-81ad0db1e819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765c514d-3c56-48bd-b059-81ad0db1e819', 'volume_size': 1}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449659839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765c514d-3c56-48bd-b059-81ad0db1e819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:34Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Creating volume 765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:34 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:34 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 1073741824
Sep 09 13:34:34 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:34 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 1073741824" returned: 0 in 0.409s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:34 devstack sudo[108645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819
Sep 09 13:34:34 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:34 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819" returned: 0 in 0.252s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d179cca5-d1f6-4bb3-85a7-a0631627d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765c514d-3c56-48bd-b059-81ad0db1e819', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f35b56-70a9-4653-b28f-1ddfd7b69682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:34 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Volume volume-765c514d-3c56-48bd-b059-81ad0db1e819 (765c514d-3c56-48bd-b059-81ad0db1e819): created successfully
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f35b56-70a9-4653-b28f-1ddfd7b69682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:34 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (1301960d-7b20-4661-8bfa-0495b4bee232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:34 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-7f680054-9519-4ca6-9d92-cb78a4828747 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot 6fc8a08a-7e0c-4ac9-9384-b4eebf098182 of volume 765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a9594-c3d9-4365-8264-2e0bfaedae47]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:35 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819
Sep 09 13:34:35 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:35 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819" returned: 0 in 0.365s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:35 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:35 devstack sudo[108654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 1G
Sep 09 13:34:35 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:36 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 1G" returned: 0 in 0.377s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c514d-3c56-48bd-b059-81ad0db1e819 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:36 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c514d-3c56-48bd-b059-81ad0db1e819 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182
Sep 09 13:34:36 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:36 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765c514d-3c56-48bd-b059-81ad0db1e819 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182" returned: 0 in 0.285s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:36 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 is being set with open permissions: ugo+rw
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:36 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182
Sep 09 13:34:36 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:36 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182" returned: 0 in 0.237s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:36 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info
Sep 09 13:34:36 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:36 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:36 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info is being set with open permissions: ugo+rw
Sep 09 13:34:36 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:36 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info
Sep 09 13:34:36 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:37 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.info" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:37 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-decbd9d6-8893-4821-bef1-613351c737d8 tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-6fc8a08a-7e0c-4ac9-9384-b4eebf098182-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-6fc8a08a-7e0c-4ac9-9384-b4eebf098182-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-6fc8a08a-7e0c-4ac9-9384-b4eebf098182" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-6fc8a08a-7e0c-4ac9-9384-b4eebf098182" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot 6fc8a08a-7e0c-4ac9-9384-b4eebf098182 of volume 765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c9402-d5da-4438-8662-71edc667284d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:37 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182
Sep 09 13:34:37 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:37 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-765c514d-3c56-48bd-b059-81ad0db1e819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0804422-4c59-480f-97bf-5ed97718382e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:37 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:38 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819
Sep 09 13:34:38 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:38 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819" returned: 0 in 0.348s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:38 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182
Sep 09 13:34:38 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:38 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182" returned: 0 in 0.325s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:38 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182
Sep 09 13:34:38 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:38 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819.6fc8a08a-7e0c-4ac9-9384-b4eebf098182" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-6fc8a08a-7e0c-4ac9-9384-b4eebf098182" released by "_delete_snapshot" :: held 1.354s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" released by "delete_snapshot" :: held 1.374s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Created reservations ['1da233e2-783b-4aa8-bb7a-fb377e8f6f50', '50df480b-a832-4d1f-b0aa-b2d49d6f2620', '22c9709c-18fa-4f89-a3da-1b709dd3c6e1', 'b1243a24-cbc0-496b-b219-a7289648c4e1'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:38 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:38 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-01b73511-bdd6-45b7-b4b1-998f38e55534 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-6fc8a08a-7e0c-4ac9-9384-b4eebf098182-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-765c514d-3c56-48bd-b059-81ad0db1e819-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-765c514d-3c56-48bd-b059-81ad0db1e819-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" acquired by "delete_volume" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16f0e5d-80cf-4e2e-b541-d0d015b3fd3d]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:39 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:39 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819
Sep 09 13:34:39 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:40 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:40 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819
Sep 09 13:34:40 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:40 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-765c514d-3c56-48bd-b059-81ad0db1e819" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-765c514d-3c56-48bd-b059-81ad0db1e819" released by "delete_volume" :: held 0.646s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Created reservations ['03429dd3-f5e3-40b6-b48d-e52dde53caa5', 'f9d08553-4107-43a5-9d51-6ee9640afea8', '379b3422-386e-41ed-89a2-9476554e30df', 'f7d57a7e-0037-4a13-a6f2-169f3c33c000'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:40 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:40 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:40 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:40 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:40 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-1f4dd0a0-a74f-4df2-be56-64070b254b91 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-765c514d-3c56-48bd-b059-81ad0db1e819-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (3fb11b78-6a7b-4af1-aca1-6dbb7af35e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c743a-fe5b-47e2-988e-0604abb32ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c743a-fe5b-47e2-988e-0604abb32ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796398250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3cc747-a4f6-414e-acd4-3801504b2b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:41Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f52719-b1be-4e1a-97ac-491bf276307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f52719-b1be-4e1a-97ac-491bf276307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0446da8-9b1e-4378-8954-ad961f914e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0446da8-9b1e-4378-8954-ad961f914e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3cc747-a4f6-414e-acd4-3801504b2b1d', 'volume_name': 'volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ea0727-1d96-40ff-8b25-ceea90d6a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ea0727-1d96-40ff-8b25-ceea90d6a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a92f220-67ec-449d-ba2a-e7f3c5b67e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Volume 0b3cc747-a4f6-414e-acd4-3801504b2b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d', 'volume_size': 1}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796398250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3cc747-a4f6-414e-acd4-3801504b2b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:41Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Creating volume 0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:41 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:41 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d 1073741824
Sep 09 13:34:41 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:41 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d 1073741824" returned: 0 in 0.396s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:41 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d
Sep 09 13:34:41 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:41 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d" returned: 0 in 0.246s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a92f220-67ec-449d-ba2a-e7f3c5b67e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2b8a0-4dd5-4ce0-9e02-c684dbde6a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:41 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Volume volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d (0b3cc747-a4f6-414e-acd4-3801504b2b1d): created successfully
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2b8a0-4dd5-4ce0-9e02-c684dbde6a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:41 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (3fb11b78-6a7b-4af1-aca1-6dbb7af35e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:42 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-61c61618-4108-410f-bcc8-397e1d31c9e8 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot af519824-e2bb-4ca5-aefb-0bb2519b02f2 of volume 0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d414a91-ac08-4cff-a0e1-cd2c44ff17eb]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:42 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d
Sep 09 13:34:42 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:42 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:42 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:42 devstack sudo[108718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 1G
Sep 09 13:34:42 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:43 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 1G" returned: 0 in 0.398s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:43 devstack sudo[108723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2
Sep 09 13:34:43 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:43 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2" returned: 0 in 0.286s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:43 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 is being set with open permissions: ugo+rw
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:43 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2
Sep 09 13:34:43 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:43 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:43 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info
Sep 09 13:34:43 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:43 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info" returned: 0 in 0.250s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:43 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info is being set with open permissions: ugo+rw
Sep 09 13:34:43 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:43 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info
Sep 09 13:34:43 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:44 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.info" returned: 0 in 0.248s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:44 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-0699b35d-6aec-4be2-8aad-caecfa5260bf tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-af519824-e2bb-4ca5-aefb-0bb2519b02f2-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-af519824-e2bb-4ca5-aefb-0bb2519b02f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-af519824-e2bb-4ca5-aefb-0bb2519b02f2" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-af519824-e2bb-4ca5-aefb-0bb2519b02f2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot af519824-e2bb-4ca5-aefb-0bb2519b02f2 of volume 0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[2028f46d-e187-4798-94a9-6adbb1663da3]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:44 devstack sudo[108737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2
Sep 09 13:34:44 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:44 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2" returned: 0 in 0.354s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4bda9-1ee2-46f4-a921-95185ac26357]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:44 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:45 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d
Sep 09 13:34:45 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:45 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:45 devstack sudo[108747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2
Sep 09 13:34:45 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:45 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2" returned: 0 in 0.334s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:45 devstack sudo[108753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2
Sep 09 13:34:45 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:45 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d.af519824-e2bb-4ca5-aefb-0bb2519b02f2" returned: 0 in 0.241s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-af519824-e2bb-4ca5-aefb-0bb2519b02f2" released by "_delete_snapshot" :: held 1.365s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" released by "delete_snapshot" :: held 1.386s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Created reservations ['3bfc19b7-e865-425e-b714-a9a38f07f8f1', '047b63a8-2673-483b-a23e-8fe423479b7c', '107d4a40-ab53-4966-b635-27c5954e591c', '35e87892-6738-416a-b706-aea7c2e50b5a'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:45 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:45 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-ad9f791f-870a-4cbf-a5cb-bc5ca2fb6057 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-af519824-e2bb-4ca5-aefb-0bb2519b02f2-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-0b3cc747-a4f6-414e-acd4-3801504b2b1d-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "cinder-0b3cc747-a4f6-414e-acd4-3801504b2b1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" acquired by "delete_volume" :: waited 0.018s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940b24e-1ec7-4e44-91aa-c40c7a0fb316]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:46 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:46 devstack sudo[108756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d
Sep 09 13:34:46 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:47 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:47 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d
Sep 09 13:34:47 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:47 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-0b3cc747-a4f6-414e-acd4-3801504b2b1d" returned: 0 in 0.261s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-0b3cc747-a4f6-414e-acd4-3801504b2b1d" released by "delete_volume" :: held 0.664s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Created reservations ['48864945-3fa6-4df9-9e8e-3d0702a32329', '1febfc11-c6e8-42c8-8c75-1ba9bb6468eb', '9ec1f257-3156-4e66-a826-445e50f5d71d', '236d597b-8c5c-4637-aeaf-3aaaa8af2b73'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:47 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:47 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:47 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.250s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:47 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:47 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-34248a2d-09b2-4623-83ce-5637e8a8f92b tempest-ProjectMemberTests-1168539348 None] Lock "cinder-0b3cc747-a4f6-414e-acd4-3801504b2b1d-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.flows.manager.create_volume [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87606) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (04612ff9-bccd-4453-b81a-ff7ac57bd0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e2e778-b404-4ca4-8c44-659e24a18e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e2e778-b404-4ca4-8c44-659e24a18e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921051906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ebb288-85a5-4b08-94f1-e43f221645c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:48Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326312a2-5414-4e6f-ab4f-80508707b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326312a2-5414-4e6f-ab4f-80508707b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cbc922-7bf4-4ade-8590-ed90f01925da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cbc922-7bf4-4ade-8590-ed90f01925da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ebb288-85a5-4b08-94f1-e43f221645c7', 'volume_name': 'volume-c0ebb288-85a5-4b08-94f1-e43f221645c7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c90e91-742f-4e6c-8278-ed1b7a9e4b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c90e91-742f-4e6c-8278-ed1b7a9e4b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805998c3-c21e-4d35-a453-2d690ef23f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Volume c0ebb288-85a5-4b08-94f1-e43f221645c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ebb288-85a5-4b08-94f1-e43f221645c7', 'volume_size': 1}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ab5468a1280>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-09T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921051906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ebb288-85a5-4b08-94f1-e43f221645c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410da328312e4cca9796c8aa885a930b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T11:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T11:34:48Z,use_quota=True,user_id='b1ea869429524accb6fb98c60d75fa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae),volume_type_id=b4ffb8c1-4a90-4a73-aa9e-a0f4479189ae)}" {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Creating volume c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Selected osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3 as target Quobyte volume. {{(pid=87606) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 09 13:34:48 devstack cinder-volume[87606]: INFO cinder.volume.drivers.remotefs [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] casted to osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 1073741824 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:48 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 1073741824
Sep 09 13:34:48 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:48 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 1073741824" returned: 0 in 0.401s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:48 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7
Sep 09 13:34:48 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:48 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7" returned: 0 in 0.253s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'} {{(pid=87606) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805998c3-c21e-4d35-a453-2d690ef23f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ebb288-85a5-4b08-94f1-e43f221645c7', 'volume_size': 1}' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:48 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03876b5f-b43c-4ce2-bcf3-9a430cea344f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 09 13:34:48 devstack cinder-volume[87606]: INFO cinder.volume.flows.manager.create_volume [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Volume volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 (c0ebb288-85a5-4b08-94f1-e43f221645c7): created successfully
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03876b5f-b43c-4ce2-bcf3-9a430cea344f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87606) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Flow 'volume_create_manager' (04612ff9-bccd-4453-b81a-ff7ac57bd0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87606) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 09 13:34:49 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-3128b827-b16b-4cae-af8c-8ee7a48df846 tempest-ProjectMemberTests-1168539348 None] Created volume successfully.
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Creating offline snapshot ee65c789-e5b6-4a08-baa8-54b55069a8fc of volume c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b926f7-8df5-407e-ba90-151575d6f36c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:49 devstack sudo[108775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7
Sep 09 13:34:49 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:49 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7" returned: 0 in 0.358s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:49 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc 1G {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:49 devstack sudo[108781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc 1G
Sep 09 13:34:49 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:50 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc 1G" returned: 0 in 0.382s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:50 devstack sudo[108786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc
Sep 09 13:34:50 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:50 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 -F qcow2 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc" returned: 0 in 0.288s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:50 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc is being set with open permissions: ugo+rw
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:50 devstack sudo[108792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc
Sep 09 13:34:50 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:50 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc" returned: 0 in 0.240s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:50 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info
Sep 09 13:34:50 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:50 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info" returned: 0 in 0.248s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:50 devstack cinder-volume[87606]: WARNING cinder.volume.drivers.remotefs [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info is being set with open permissions: ugo+rw
Sep 09 13:34:50 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:50 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info
Sep 09 13:34:50 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:51 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.info" returned: 0 in 0.241s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:51 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-28f36658-f124-424d-9bde-f83a6f71661b tempest-ProjectMemberTests-1168539348 None] Create snapshot completed successfully
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-ee65c789-e5b6-4a08-baa8-54b55069a8fc-delete_snapshot" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-ee65c789-e5b6-4a08-baa8-54b55069a8fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" by "delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-ee65c789-e5b6-4a08-baa8-54b55069a8fc" by "_delete_snapshot" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-ee65c789-e5b6-4a08-baa8-54b55069a8fc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Deleting offline snapshot ee65c789-e5b6-4a08-baa8-54b55069a8fc of volume c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] snapshot_file for this snap is: volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e27b4c-f94b-42ea-a9ed-a8219e5b3d3e]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:51 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc
Sep 09 13:34:51 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:51 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc" returned: 0 in 0.349s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:51 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.remotefs [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ebb288-85a5-4b08-94f1-e43f221645c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87606) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7d749-d833-4114-9471-723d8df2509c]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:52 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7
Sep 09 13:34:52 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:52 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7" returned: 0 in 0.350s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:52 devstack sudo[108811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc
Sep 09 13:34:52 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:52 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc" returned: 0 in 0.332s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:52 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc
Sep 09 13:34:52 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:52 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7.ee65c789-e5b6-4a08-baa8-54b55069a8fc" returned: 0 in 0.242s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-ee65c789-e5b6-4a08-baa8-54b55069a8fc" released by "_delete_snapshot" :: held 1.357s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:52 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" released by "delete_snapshot" :: held 1.378s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Created reservations ['7371ccf1-deb9-481a-b70c-2d33564228ab', '9998c4d2-263b-4cda-897b-17c0b25f3451', '6e90a724-eeb3-4f74-864b-58bb2bc3bac4', 'af2dd0d6-a144-4fef-a8b8-4e7844955efe'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:53 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Delete snapshot completed successfully.
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-b1622e32-6874-41d4-80b2-88f033568ac1 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-ee65c789-e5b6-4a08-baa8-54b55069a8fc-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-c0ebb288-85a5-4b08-94f1-e43f221645c7-delete_volume" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-c0ebb288-85a5-4b08-94f1-e43f221645c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" by "delete_volume" {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" acquired by "delete_volume" :: waited 0.016s {{(pid=87606) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c912cdc-8022-41fe-8a5f-eaed7c274b23]: (4, 'qcow2') {{(pid=89221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 09 13:34:53 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:53 devstack sudo[108820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7
Sep 09 13:34:53 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:54 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7" returned: 0 in 0.352s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7 {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:54 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7
Sep 09 13:34:54 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:54 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c/volume-c0ebb288-85a5-4b08-94f1-e43f221645c7" returned: 0 in 0.256s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-quobyte-c0ebb288-85a5-4b08-94f1-e43f221645c7" released by "delete_volume" :: held 0.661s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.quota [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Created reservations ['032f2cdf-b243-493c-b686-9feadc30087a', 'efd14d06-7b30-4097-9475-47c66eb50553', '2baf8046-1e23-4baf-8253-f93b30b2659f', '88a978e7-7f50-447e-9a04-15af7345d15d'] {{(pid=87606) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:34:54 devstack sudo[108828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:34:54 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:34:54 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.247s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:34:54 devstack cinder-volume[87606]: INFO cinder.volume.manager [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Deleted volume successfully.
Sep 09 13:34:54 devstack cinder-volume[87606]: DEBUG cinder.coordination [None req-f01ccd7c-e2e3-47a7-ae76-80f661bfa8f0 tempest-ProjectMemberTests-1168539348 None] Lock "cinder-c0ebb288-85a5-4b08-94f1-e43f221645c7-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87606) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 09 13:35:04 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=107,cinder:SELECT=83,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:35:04 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=106,cinder:DELETE=8,cinder:SELECT=77,cinder:INSERT=29 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3': None} {{(pid=87606) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d54a68a5-4c8f-4dc4-8c81-6b8b5313e4e3'] {{(pid=87606) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.lockutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 09 13:35:25 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c
Sep 09 13:35:25 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 09 13:35:25 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_concurrency.processutils [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8522d6ac11b88b3405f9ee6acc05f78c" returned: 0 in 0.243s {{(pid=87606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG cinder.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Notifying Schedulers of capabilities ... {{(pid=87606) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG oslo_service.periodic_task [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87606) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread count: 28 {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 09 13:35:25 devstack cinder-volume[87606]: DEBUG cinder.volume.manager [None req-ef9c9eb3-1f39-4701-bfd6-2b44a8e8b1d3 None None] thread info: [<_MainThread(MainThread, started 134919105347712)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134918995845056)>, <Thread(Thread-3 (stat_writer), started daemon 134918990017792)>, <Thread(Rabbit-heartbeat, started daemon 134918990783808)>, <Thread(Thread-5 (_runner), started daemon 134918988821824)>, <Thread(Thread-7 (_runner), started daemon 134918988837504)>, <Thread(fd_logger, started daemon 134918986815232)>, <Thread(privsep_reader, started daemon 134918984740608)>, <Thread(tpool_thread_0, started daemon 134918979258048)>, <Thread(tpool_thread_1, started daemon 134918970865344)>, <Thread(tpool_thread_2, started daemon 134918962472640)>, <Thread(tpool_thread_3, started daemon 134918954079936)>, <Thread(tpool_thread_4, started daemon 134918945687232)>, <Thread(tpool_thread_5, started daemon 134918937294528)>, <Thread(tpool_thread_6, started daemon 134918928901824)>, <Thread(tpool_thread_7, started daemon 134918920509120)>, <Thread(tpool_thread_8, started daemon 134918912116416)>, <Thread(tpool_thread_9, started daemon 134918903723712)>, <Thread(tpool_thread_10, started daemon 134918895331008)>, <Thread(tpool_thread_11, started daemon 134918886938304)>, <Thread(tpool_thread_12, started daemon 134918878545600)>, <Thread(tpool_thread_13, started daemon 134918870152896)>, <Thread(tpool_thread_14, started daemon 134918861760192)>, <Thread(tpool_thread_15, started daemon 134918853367488)>, <Thread(tpool_thread_16, started daemon 134918844974784)>, <Thread(tpool_thread_17, started daemon 134918836582080)>, <Thread(tpool_thread_18, started daemon 134918828189376)>, <Thread(tpool_thread_19, started daemon 134918819780288)>] {{(pid=87606) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 09 13:35:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:SELECT=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 09 13:35:32 devstack cinder-volume[87606]: DEBUG dbcounter [-] [87606] Writing DB stats cinder:UPDATE=1 {{(pid=87606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}